[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:37 dist-test-slave-7kzw krb5kdc[16031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:37 dist-test-slave-7kzw krb5kdc[16031](info): set up 2 sockets
Aug 12 11:16:37 dist-test-slave-7kzw krb5kdc[16031](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 11:16:38.758996 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:16:38 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:16:38.972812 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45499
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:45499
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:39.351487 16058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:39.351872 16058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:39.352051 16058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:39.359613 16058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:39.359779 16058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:39.359889 16058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:39.359995 16058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:39.360083 16058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:39.370736 16058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:45499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:39.372427 16058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:39.373919 16058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:39.388049 16077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:39.388082 16073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:39.388821 16080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:39.389089 16058 server_base.cc:1034] running on GCE node
I20260812 11:16:39.390033 16058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:39.391793 16058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:39.393077 16058 hybrid_clock.cc:648] HybridClock initialized: now 1786533399393024 us; error 114 us; skew 500 ppm
I20260812 11:16:39.393555 16058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:39 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533399, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:39.401901 16058 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:16:39.403980 16058 webserver.cc:460] Webserver started at http://127.15.164.254:33605/ using document root <none> and password file <none>
I20260812 11:16:39.404837 16058 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:39.404959 16058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:39.405269 16058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:39.408890 16058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "680ecf9d4ea149dcb94edc42f064b8ce"
format_stamp: "Formatted at 2026-08-12 11:16:39 on dist-test-slave-7kzw"
server_key: "e2d60dfdfa3a3d45ba0bf257fd1a19ad"
server_key_iv: "33fc9588836f2b7263fbe2a08829cc3d"
server_key_version: "encryptionkey@0"
I20260812 11:16:39.409731 16058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "680ecf9d4ea149dcb94edc42f064b8ce"
format_stamp: "Formatted at 2026-08-12 11:16:39 on dist-test-slave-7kzw"
server_key: "e2d60dfdfa3a3d45ba0bf257fd1a19ad"
server_key_iv: "33fc9588836f2b7263fbe2a08829cc3d"
server_key_version: "encryptionkey@0"
I20260812 11:16:39.416383 16058 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 11:16:39.420433 16090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:39.422009 16058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:16:39.422236 16058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "680ecf9d4ea149dcb94edc42f064b8ce"
format_stamp: "Formatted at 2026-08-12 11:16:39 on dist-test-slave-7kzw"
server_key: "e2d60dfdfa3a3d45ba0bf257fd1a19ad"
server_key_iv: "33fc9588836f2b7263fbe2a08829cc3d"
server_key_version: "encryptionkey@0"
I20260812 11:16:39.422464 16058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:39.452636 16058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:39.457185 16058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:39.457501 16058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:39.479331 16058 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:45499
I20260812 11:16:39.479350 16173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:45499 every 8 connection(s)
I20260812 11:16:39.481117 16058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:39.484910 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16058
I20260812 11:16:39.485299 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:16:39.486505 16175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:39.488274 16019 external_mini_cluster.cc:1428] Setting key c8fc27d7d010176f9021d87dd7303387
I20260812 11:16:39.502094 16175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce: Bootstrap starting.
I20260812 11:16:39.506637 16175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:39.508499 16175 log.cc:824] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:39.512394 16175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce: No bootstrap required, opened a new log
I20260812 11:16:39.522327 16175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } }
I20260812 11:16:39.522879 16175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:39.523030 16175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680ecf9d4ea149dcb94edc42f064b8ce, State: Initialized, Role: FOLLOWER
I20260812 11:16:39.523907 16175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } }
I20260812 11:16:39.524174 16175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:39.524371 16175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:39.524585 16175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 0 FOLLOWER]: Advancing to term 1
Aug 12 11:16:39 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:39.527685 16175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } }
I20260812 11:16:39.528427 16175 leader_election.cc:302] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 680ecf9d4ea149dcb94edc42f064b8ce; no voters:
I20260812 11:16:39.529294 16175 leader_election.cc:288] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:39.529495 16190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:39.530263 16190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [term 1 LEADER]: Becoming Leader. State: Replica: 680ecf9d4ea149dcb94edc42f064b8ce, State: Running, Role: LEADER
I20260812 11:16:39.531018 16190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } }
I20260812 11:16:39.534188 16193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } } }
I20260812 11:16:39.534685 16193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:39.539225 16190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 680ecf9d4ea149dcb94edc42f064b8ce. Latest consensus state: current_term: 1 leader_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "680ecf9d4ea149dcb94edc42f064b8ce" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45499 } } }
I20260812 11:16:39.539525 16190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:39.541119 16179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:39.494295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.15.164.254:45499)
0812 11:16:39.495473 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:39.495491 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:39.497277 (+ 1786us) server_negotiation.cc:407] Connection header received
0812 11:16:39.508357 (+ 11080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:39.508394 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:39.509045 (+ 651us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:39.509618 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:39.513376 (+ 3758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:39.515586 (+ 2210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:39.517811 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:39.519127 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:39.519400 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:39.527008 (+ 7608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:39.527022 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:39.527046 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:39.527107 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:39.532843 (+ 5736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:39.534627 (+ 1784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:39.534640 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:39.534653 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:39.534968 (+ 315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:39.535815 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:39.535823 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:39.535829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:39.536953 (+ 1124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:39.538916 (+ 1963us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:39.539263 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 11:16:39.539857 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":518,"threads_started":1}
I20260812 11:16:39.543998 16175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:39.547279 16198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:39.554111 16198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:39.565347 16198 catalog_manager.cc:1347] Generated new cluster ID: 75a24011631a482aab63cf1ab645c8ad
I20260812 11:16:39.565528 16198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:39.584970 16198 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:39.586776 16198 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:39.604554 16198 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 680ecf9d4ea149dcb94edc42f064b8ce: Generated new TSK 0
I20260812 11:16:39.605631 16198 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:16:39.667201 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:40.053498 16226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:40.053812 16226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:40.053968 16226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:40.061781 16226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:40.061902 16226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:40.062084 16226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:16:40.072659 16226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:40.074084 16226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:40.075590 16226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:40.089900 16234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:40.089870 16238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:40.089848 16235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:40.090701 16226 server_base.cc:1034] running on GCE node
I20260812 11:16:40.091497 16226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:40.092607 16226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:40.093834 16226 hybrid_clock.cc:648] HybridClock initialized: now 1786533400093791 us; error 30 us; skew 500 ppm
I20260812 11:16:40.094163 16226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:40 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533400, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:40.097790 16226 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:16:40.099407 16226 webserver.cc:460] Webserver started at http://127.15.164.193:33407/ using document root <none> and password file <none>
I20260812 11:16:40.100131 16226 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:40.100327 16226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:40.100636 16226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:40.103719 16226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "4639db5ff3984199806a597bed1c25a5"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "832151119d5a17b35825ba0dd49871d5"
server_key_iv: "744e31b8257779c414ae91fe01aa488b"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.104504 16226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "4639db5ff3984199806a597bed1c25a5"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "832151119d5a17b35825ba0dd49871d5"
server_key_iv: "744e31b8257779c414ae91fe01aa488b"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.109942 16226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:16:40.113942 16249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.115584 16226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:16:40.115789 16226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "4639db5ff3984199806a597bed1c25a5"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "832151119d5a17b35825ba0dd49871d5"
server_key_iv: "744e31b8257779c414ae91fe01aa488b"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.115995 16226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:40.128634 16226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:40.133200 16226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:40.133514 16226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:40.134739 16226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:40.136241 16226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:40.136317 16226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.136454 16226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:40.136520 16226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.177549 16226 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:33547
I20260812 11:16:40.177606 16437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:33547 every 8 connection(s)
I20260812 11:16:40.179024 16226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:16:40.183717 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16226
I20260812 11:16:40.184006 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:16:40.184773 16019 external_mini_cluster.cc:1428] Setting key a90b7b3bb7703d99720f9027feb25bff
Aug 12 11:16:40 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533400, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:40.204633 16441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:40.182425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:57361 (local address 127.15.164.254:45499)
0812 11:16:40.183137 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:40.183143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:40.184128 (+ 985us) server_negotiation.cc:407] Connection header received
0812 11:16:40.186277 (+ 2149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:40.186282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:40.186366 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:40.186539 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:40.188384 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.189716 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.191583 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.192474 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.192641 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:40.196817 (+ 4176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:40.196824 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:40.196829 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:40.196868 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:40.200458 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:40.201545 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:40.201550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:40.201552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:40.201709 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:40.202348 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:40.202352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:40.202355 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:40.202835 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:40.203000 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:40.204142 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0812 11:16:40.204350 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":366,"threads_started":1}
I20260812 11:16:40.206300 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:40.183038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45499 (local address 127.15.164.193:57361)
0812 11:16:40.183925 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:40.183983 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:40.185953 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:40.186818 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:40.186852 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:40.187612 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:40.188191 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:40.188208 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.189943 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.189948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:40.191390 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:40.191409 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.192742 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.192748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:40.192979 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:40.193749 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:40.193773 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:40.196494 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:40.200659 (+ 4165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:40.200673 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:40.200696 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:40.201391 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:40.201859 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:40.201867 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:40.201874 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:40.202179 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:40.202990 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:40.203004 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:40.203560 (+ 556us) client_negotiation.cc:769] Sending connection context
0812 11:16:40.203960 (+ 400us) client_negotiation.cc:240] Negotiation successful
0812 11:16:40.204720 (+ 760us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":365,"threads_started":1}
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:16:40.208138 16439 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45499
I20260812 11:16:40.208467 16439 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:40.209316 16439 heartbeater.cc:511] Master 127.15.164.254:45499 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
I20260812 11:16:40.212028 16117 ts_manager.cc:194] Registered new tserver with Master: 4639db5ff3984199806a597bed1c25a5 (127.15.164.193:33547)
I20260812 11:16:40.213619 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:57361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:16:40.238770 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:40.601388 16446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:40.601722 16446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:40.601825 16446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:40.609757 16446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:40.609889 16446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:40.610008 16446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:16:40.621187 16446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:40.622776 16446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:40.624176 16446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:40.639246 16457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:40.639220 16455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:40.639178 16454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:40.640381 16446 server_base.cc:1034] running on GCE node
I20260812 11:16:40.641076 16446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:40.642102 16446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:40.643344 16446 hybrid_clock.cc:648] HybridClock initialized: now 1786533400643251 us; error 85 us; skew 500 ppm
I20260812 11:16:40.643710 16446 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:40 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533400, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:40.647311 16446 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:16:40.649024 16446 webserver.cc:460] Webserver started at http://127.15.164.194:43645/ using document root <none> and password file <none>
I20260812 11:16:40.649768 16446 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:40.649922 16446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:40.650264 16446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:40.653416 16446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "c20467bd8b4f4cb7b179a55d7812c3db"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "5432fcca136f8fa03576766880851d25"
server_key_iv: "8c9ee5942934eb0f2988a93d454a4ddc"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.654194 16446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "c20467bd8b4f4cb7b179a55d7812c3db"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "5432fcca136f8fa03576766880851d25"
server_key_iv: "8c9ee5942934eb0f2988a93d454a4ddc"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.659724 16446 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 11:16:40.663736 16476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.665162 16446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:16:40.665344 16446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "c20467bd8b4f4cb7b179a55d7812c3db"
format_stamp: "Formatted at 2026-08-12 11:16:40 on dist-test-slave-7kzw"
server_key: "5432fcca136f8fa03576766880851d25"
server_key_iv: "8c9ee5942934eb0f2988a93d454a4ddc"
server_key_version: "encryptionkey@0"
I20260812 11:16:40.665609 16446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:40.683702 16446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:40.688702 16446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:40.689034 16446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:40.690157 16446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:40.691761 16446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:40.691874 16446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.692036 16446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:40.692112 16446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:40.734326 16446 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:35055
I20260812 11:16:40.734391 16647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:35055 every 8 connection(s)
I20260812 11:16:40.735853 16446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:16:40.740247 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16446
I20260812 11:16:40.740520 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:16:40.741099 16019 external_mini_cluster.cc:1428] Setting key 7e18d6e03945a58a1f5c5c42aaaf370f
Aug 12 11:16:40 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533400, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:40.760685 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:40.738854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:37883 (local address 127.15.164.254:45499)
0812 11:16:40.739392 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:40.739396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:40.741898 (+ 2502us) server_negotiation.cc:407] Connection header received
0812 11:16:40.743458 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:40.743464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:40.743563 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:40.743690 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:40.745504 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.746255 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.748143 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.748618 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.748846 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:40.753575 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:40.753581 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:40.753585 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:40.753622 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:40.756532 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:40.757774 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:40.757780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:40.757782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:40.757985 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:40.758620 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:40.758624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:40.758626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:40.758942 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:40.759127 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:40.759973 (+ 846us) server_negotiation.cc:299] Negotiation successful
0812 11:16:40.760252 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":274,"threads_started":1}
I20260812 11:16:40.761848 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:40.739360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45499 (local address 127.15.164.194:37883)
0812 11:16:40.740425 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:40.740503 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:40.743104 (+ 2601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:40.743962 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:40.743972 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:40.744582 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:40.745333 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:40.745354 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.746444 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.746448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:40.747983 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:40.747996 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:40.748948 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:40.748956 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:40.749222 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:40.749978 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:40.750002 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:40.753269 (+ 3267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:40.756699 (+ 3430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:40.756713 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:40.756737 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:40.757567 (+ 830us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:40.758146 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:40.758153 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:40.758158 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:40.758422 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:40.759101 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:40.759111 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:40.759534 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 11:16:40.759856 (+ 322us) client_negotiation.cc:240] Negotiation successful
0812 11:16:40.760505 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":446,"threads_started":1}
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:16:40.763783 16649 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45499
I20260812 11:16:40.764189 16649 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:40.765040 16649 heartbeater.cc:511] Master 127.15.164.254:45499 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
I20260812 11:16:40.766901 16117 ts_manager.cc:194] Registered new tserver with Master: c20467bd8b4f4cb7b179a55d7812c3db (127.15.164.194:35055)
I20260812 11:16:40.767861 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:37883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:16:40.794836 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:41.190376 16659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:41.190824 16659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:41.190999 16659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:41.198729 16659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:41.198904 16659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:41.199142 16659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:16:41.209793 16659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45499
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:41.211519 16659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:41.213050 16659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:16:41.216863 16439 heartbeater.cc:503] Master 127.15.164.254:45499 was elected leader, sending a full tablet report...
W20260812 11:16:41.228427 16668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:41.228389 16669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:41.228410 16671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:41.229359 16659 server_base.cc:1034] running on GCE node
I20260812 11:16:41.230136 16659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:41.231331 16659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:41.232782 16659 hybrid_clock.cc:648] HybridClock initialized: now 1786533401232530 us; error 78 us; skew 500 ppm
I20260812 11:16:41.233212 16659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:41.236837 16659 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:16:41.238767 16659 webserver.cc:460] Webserver started at http://127.15.164.195:46309/ using document root <none> and password file <none>
I20260812 11:16:41.239562 16659 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:41.239735 16659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:41.240098 16659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:41.243474 16659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "abdb9c0907fe4ca19e8b744a4205e0ea"
format_stamp: "Formatted at 2026-08-12 11:16:41 on dist-test-slave-7kzw"
server_key: "e80a995d9805714a8750a33464308690"
server_key_iv: "545f6936e37125f1df8431588642f564"
server_key_version: "encryptionkey@0"
I20260812 11:16:41.244437 16659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "abdb9c0907fe4ca19e8b744a4205e0ea"
format_stamp: "Formatted at 2026-08-12 11:16:41 on dist-test-slave-7kzw"
server_key: "e80a995d9805714a8750a33464308690"
server_key_iv: "545f6936e37125f1df8431588642f564"
server_key_version: "encryptionkey@0"
I20260812 11:16:41.250947 16659 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 11:16:41.255092 16683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:41.256625 16659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:16:41.256880 16659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "abdb9c0907fe4ca19e8b744a4205e0ea"
format_stamp: "Formatted at 2026-08-12 11:16:41 on dist-test-slave-7kzw"
server_key: "e80a995d9805714a8750a33464308690"
server_key_iv: "545f6936e37125f1df8431588642f564"
server_key_version: "encryptionkey@0"
I20260812 11:16:41.257112 16659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:41.273124 16659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:41.278406 16659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:41.278848 16659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:41.280189 16659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:41.281721 16659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:41.281834 16659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:41.281987 16659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:41.282064 16659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:41.321694 16659 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44423
I20260812 11:16:41.321733 16868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44423 every 8 connection(s)
I20260812 11:16:41.323135 16659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:16:41.329804 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16659
I20260812 11:16:41.330060 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:16:41.330691 16019 external_mini_cluster.cc:1428] Setting key c220b377b22f5b60ad7a891e4e1aacba
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:41.347157 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.325913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:41543 (local address 127.15.164.254:45499)
0812 11:16:41.326552 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.326556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.327570 (+ 1014us) server_negotiation.cc:407] Connection header received
0812 11:16:41.329630 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.329634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.329742 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.329846 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.332110 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.333306 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.335675 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.336074 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.336208 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.340287 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.340293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.340296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.340334 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.343391 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.344218 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.344223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.344225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.344368 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.344906 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.344910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.344912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.345279 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.345404 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.346432 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.346715 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":318,"threads_started":1}
I20260812 11:16:41.348446 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.326536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45499 (local address 127.15.164.195:41543)
0812 11:16:41.327371 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:41.327437 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:41.329252 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:41.330179 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:41.330194 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:41.331054 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:41.331907 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:41.331930 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.333525 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.333531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:41.335507 (+ 1976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:41.335522 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.336292 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.336298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:41.336510 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.337258 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:41.337289 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:41.340034 (+ 2745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:41.343563 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:41.343571 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:41.343594 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:41.344076 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:41.344532 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:41.344536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:41.344539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:41.344757 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:41.345420 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:41.345427 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:41.345925 (+ 498us) client_negotiation.cc:769] Sending connection context
0812 11:16:41.346255 (+ 330us) client_negotiation.cc:240] Negotiation successful
0812 11:16:41.346931 (+ 676us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":279,"threads_started":1}
I20260812 11:16:41.350394 16869 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45499
I20260812 11:16:41.350819 16869 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:41.351630 16869 heartbeater.cc:511] Master 127.15.164.254:45499 requested a full tablet report, sending...
I20260812 11:16:41.353304 16117 ts_manager.cc:194] Registered new tserver with Master: abdb9c0907fe4ca19e8b744a4205e0ea (127.15.164.195:44423)
I20260812 11:16:41.354185 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:41543
I20260812 11:16:41.361181 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:41.415635 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.396097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57280 (local address 127.15.164.193:33547)
0812 11:16:41.397985 (+ 1888us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.397993 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.398023 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:16:41.398099 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.398106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.398335 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.398535 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.400519 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.401621 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.403418 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.404055 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.404174 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.409303 (+ 5129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.409318 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.409336 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.409380 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.412536 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.413313 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.413320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.413323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.413462 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.414044 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.414049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.414051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.414529 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.414837 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.415107 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.415339 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1706,"thread_start_us":1496,"threads_started":1}
W20260812 11:16:41.417229 16293 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57280
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:41.470057 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.454410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57296 (local address 127.15.164.193:33547)
0812 11:16:41.454714 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.454722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.455035 (+ 313us) server_negotiation.cc:407] Connection header received
0812 11:16:41.455147 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.455151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.455242 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.455338 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.456716 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.457426 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.458707 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.459137 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.459243 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.463979 (+ 4736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.463987 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.463991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.464041 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.467360 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.468062 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.468066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.468068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.468207 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.468684 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.468688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.468690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.469014 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.469224 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.469620 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.469813 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260812 11:16:41.471930 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16226
I20260812 11:16:41.487535 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.473088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.15.164.193:33547)
0812 11:16:41.473261 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.473266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.473513 (+ 247us) server_negotiation.cc:407] Connection header received
0812 11:16:41.473634 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.473637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.473696 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.473776 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.475083 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.475779 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.477427 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.477912 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.478017 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.480687 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.480695 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.480700 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.480744 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.484529 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.485254 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.485260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.485265 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.485438 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.485866 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.485871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.485874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.486224 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.486510 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.486866 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.487104 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:16:41.488420 16432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:41.575115 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16226
I20260812 11:16:41.602344 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16446
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:16:41.621199 16888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.603547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48348 (local address 127.15.164.194:35055)
0812 11:16:41.604182 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.604190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.604218 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:16:41.604285 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.604292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.604517 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.604786 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.606245 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.607554 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.608890 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.609506 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.609660 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.614200 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.614216 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.614235 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.614278 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.617647 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.618664 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.618673 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.618676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.618829 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.619282 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.619286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.619288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.619720 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.619977 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.620497 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.620736 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":317,"threads_started":1}
I20260812 11:16:41.622947 16642 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:41.709257 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16446
I20260812 11:16:41.737514 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16659
Aug 12 11:16:41 dist-test-slave-7kzw krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:16:41.755684 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:41.738670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.15.164.195:44423)
0812 11:16:41.739317 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:41.739324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:41.739354 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:16:41.739417 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:41.739424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:41.739641 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:41.739864 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:41.741165 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.742211 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.743669 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:41.744450 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:41.744636 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:41.749407 (+ 4771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:41.749420 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:41.749437 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:41.749477 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:41.752568 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.753343 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.753351 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.753353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.753489 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:41.753907 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:41.753910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:41.753912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:41.754313 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:41.754661 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:41.755158 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 11:16:41.755382 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":318,"threads_started":1}
I20260812 11:16:41.757279 16859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:41.843802 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16659
I20260812 11:16:41.871682 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16058
I20260812 11:16:41.873095 16167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:41.978720 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16058
2026-08-12T11:16:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4589 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:42 dist-test-slave-7kzw krb5kdc[16897](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:42 dist-test-slave-7kzw krb5kdc[16897](info): set up 2 sockets
Aug 12 11:16:42 dist-test-slave-7kzw krb5kdc[16897](info): commencing operation
krb5kdc: starting...
W20260812 11:16:43.307008 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:16:43 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:16:43.506820 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:38283
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:38283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:43.844830 16919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:43.845156 16919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:43.845319 16919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:43.852553 16919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:43.852664 16919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:43.852768 16919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:43.852881 16919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:43.852964 16919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:43.863006 16919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:38283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:38283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:43.864427 16919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:43.865788 16919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:43.877802 16928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:43.877945 16933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:43.878069 16929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:43.879597 16919 server_base.cc:1034] running on GCE node
I20260812 11:16:43.880465 16919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:43.881848 16919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:43.883083 16919 hybrid_clock.cc:648] HybridClock initialized: now 1786533403883022 us; error 44 us; skew 500 ppm
I20260812 11:16:43.883425 16919 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:43 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533403, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:43.886870 16919 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:16:43.888334 16919 webserver.cc:460] Webserver started at http://127.15.164.254:34761/ using document root <none> and password file <none>
I20260812 11:16:43.889052 16919 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:43.889192 16919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:43.889531 16919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:43.892562 16919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "c57c324022ea48178c776f4276821fb9"
format_stamp: "Formatted at 2026-08-12 11:16:43 on dist-test-slave-7kzw"
server_key: "c7fd4c8ef27c02cd6cb59fb1496542a1"
server_key_iv: "e9cdd182a4c2a9b1c8a00f00cff6b98f"
server_key_version: "encryptionkey@0"
I20260812 11:16:43.893342 16919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "c57c324022ea48178c776f4276821fb9"
format_stamp: "Formatted at 2026-08-12 11:16:43 on dist-test-slave-7kzw"
server_key: "c7fd4c8ef27c02cd6cb59fb1496542a1"
server_key_iv: "e9cdd182a4c2a9b1c8a00f00cff6b98f"
server_key_version: "encryptionkey@0"
I20260812 11:16:43.898814 16919 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:16:43.902566 16944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:43.904243 16919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:43.904498 16919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "c57c324022ea48178c776f4276821fb9"
format_stamp: "Formatted at 2026-08-12 11:16:43 on dist-test-slave-7kzw"
server_key: "c7fd4c8ef27c02cd6cb59fb1496542a1"
server_key_iv: "e9cdd182a4c2a9b1c8a00f00cff6b98f"
server_key_version: "encryptionkey@0"
I20260812 11:16:43.904767 16919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:43.933913 16919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:43.938696 16919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:43.939021 16919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:43.959239 16919 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:38283
I20260812 11:16:43.959283 17028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:38283 every 8 connection(s)
I20260812 11:16:43.960703 16919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:43.964897 17030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:43.967319 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16919
I20260812 11:16:43.967612 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:16:43.968258 16019 external_mini_cluster.cc:1428] Setting key edd766a4d85628e7469fb59b634f688b
I20260812 11:16:43.977123 17030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9: Bootstrap starting.
I20260812 11:16:43.981228 17030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:43.982662 17030 log.cc:824] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:16:43 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:43.985937 17030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9: No bootstrap required, opened a new log
I20260812 11:16:43.992547 17033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:43.970331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.15.164.254:38283)
0812 11:16:43.971167 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:43.971178 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:43.971220 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:16:43.972854 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:43.972878 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:43.973271 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:43.973610 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:43.975485 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:43.976836 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:43.978590 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:43.979280 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:43.979415 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:43.984797 (+ 5382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:43.984805 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:43.984820 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:43.984856 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:43.988185 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:43.989048 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:43.989054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:43.989060 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:43.989238 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:43.989634 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:43.989637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:43.989639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:43.990185 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:43.990405 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:43.991006 (+ 601us) server_negotiation.cc:299] Negotiation successful
0812 11:16:43.991432 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":428,"threads_started":1}
I20260812 11:16:43.994825 17030 raft_consensus.cc:348] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } }
I20260812 11:16:43.995227 17030 raft_consensus.cc:374] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:43.995375 17030 raft_consensus.cc:729] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c57c324022ea48178c776f4276821fb9, State: Initialized, Role: FOLLOWER
I20260812 11:16:43.995991 17030 consensus_queue.cc:260] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } }
I20260812 11:16:43.996279 17030 raft_consensus.cc:388] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:43.996436 17030 raft_consensus.cc:482] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:43.996622 17030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:43.998838 17030 raft_consensus.cc:504] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } }
I20260812 11:16:43.999351 17030 leader_election.cc:302] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c57c324022ea48178c776f4276821fb9; no voters:
I20260812 11:16:44.000084 17030 leader_election.cc:288] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:44.000249 17040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:44.000967 17040 raft_consensus.cc:686] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [term 1 LEADER]: Becoming Leader. State: Replica: c57c324022ea48178c776f4276821fb9, State: Running, Role: LEADER
I20260812 11:16:44.001685 17040 consensus_queue.cc:237] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } }
I20260812 11:16:44.002374 17030 sys_catalog.cc:564] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:44.005221 17044 sys_catalog.cc:455] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c57c324022ea48178c776f4276821fb9. Latest consensus state: current_term: 1 leader_uuid: "c57c324022ea48178c776f4276821fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } } }
I20260812 11:16:44.005278 17042 sys_catalog.cc:455] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c57c324022ea48178c776f4276821fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57c324022ea48178c776f4276821fb9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38283 } } }
I20260812 11:16:44.005623 17044 sys_catalog.cc:458] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:44.005700 17042 sys_catalog.cc:458] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:44.011458 17053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:44.016093 17053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:44.024792 17053 catalog_manager.cc:1347] Generated new cluster ID: 00af16039903466ba00319e44c615392
I20260812 11:16:44.024922 17053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:44.052847 17053 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:44.054261 17053 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:44.065618 17053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c57c324022ea48178c776f4276821fb9: Generated new TSK 0
I20260812 11:16:44.066609 17053 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:16:44.122596 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:44.504300 17071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:44.504585 17071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:44.504691 17071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:44.512205 17071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:44.512373 17071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:44.512598 17071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:16:44.522620 17071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:44.523893 17071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:44.525206 17071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:44.538931 17082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:44.539037 17079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:44.539276 17078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:44.540426 17071 server_base.cc:1034] running on GCE node
I20260812 11:16:44.541132 17071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:44.542137 17071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:44.543380 17071 hybrid_clock.cc:648] HybridClock initialized: now 1786533404543327 us; error 45 us; skew 500 ppm
I20260812 11:16:44.543726 17071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:44 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533404, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:44.547127 17071 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:16:44.548671 17071 webserver.cc:460] Webserver started at http://127.15.164.193:38109/ using document root <none> and password file <none>
I20260812 11:16:44.549374 17071 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:44.549528 17071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:44.549868 17071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:44.552909 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "7235a7fc6bf947cbbfa90c87738fa9b9"
format_stamp: "Formatted at 2026-08-12 11:16:44 on dist-test-slave-7kzw"
server_key: "32de3d1589d91fa5b3cb3da18baa0fdd"
server_key_iv: "6e308d16697a6672470c3a14c0ba7c21"
server_key_version: "encryptionkey@0"
I20260812 11:16:44.553702 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "7235a7fc6bf947cbbfa90c87738fa9b9"
format_stamp: "Formatted at 2026-08-12 11:16:44 on dist-test-slave-7kzw"
server_key: "32de3d1589d91fa5b3cb3da18baa0fdd"
server_key_iv: "6e308d16697a6672470c3a14c0ba7c21"
server_key_version: "encryptionkey@0"
I20260812 11:16:44.559187 17071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:16:44.563364 17094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:44.564865 17071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:44.565075 17071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "7235a7fc6bf947cbbfa90c87738fa9b9"
format_stamp: "Formatted at 2026-08-12 11:16:44 on dist-test-slave-7kzw"
server_key: "32de3d1589d91fa5b3cb3da18baa0fdd"
server_key_iv: "6e308d16697a6672470c3a14c0ba7c21"
server_key_version: "encryptionkey@0"
I20260812 11:16:44.565299 17071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:44.588644 17071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:44.593212 17071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:44.593540 17071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:44.594664 17071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:44.596076 17071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:44.596195 17071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:44.596350 17071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:44.596426 17071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:44.631623 17071 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:36877
I20260812 11:16:44.631731 17270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:36877 every 8 connection(s)
I20260812 11:16:44.632992 17071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:16:44.637257 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17071
I20260812 11:16:44.637519 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:16:44.638432 16019 external_mini_cluster.cc:1428] Setting key 18f4173fa3f3358f99e1178ba18025f7
Aug 12 11:16:44 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533404, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:44.657624 17274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:44.635820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:50019 (local address 127.15.164.254:38283)
0812 11:16:44.636326 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:44.636330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:44.637396 (+ 1066us) server_negotiation.cc:407] Connection header received
0812 11:16:44.640054 (+ 2658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:44.640058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:44.640123 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:44.640218 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:44.642523 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:44.643267 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:44.644895 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:44.645299 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:44.645450 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:44.649817 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:44.649825 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:44.649833 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:44.649883 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:44.653784 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:44.654713 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:44.654722 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:44.654728 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:44.654891 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:44.655408 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:44.655416 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:44.655422 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:44.655841 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:44.656002 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:44.656813 (+ 811us) server_negotiation.cc:299] Negotiation successful
0812 11:16:44.657116 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":277,"threads_started":1}
I20260812 11:16:44.658715 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:44.636164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:38283 (local address 127.15.164.193:50019)
0812 11:16:44.637163 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:44.637225 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:44.639747 (+ 2522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:44.640536 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:44.640546 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:44.641360 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:44.642255 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:44.642293 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:44.643443 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:44.643451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:44.644727 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:44.644740 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:44.645551 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:44.645560 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:44.645817 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:44.646671 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:44.646697 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:44.649521 (+ 2824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:44.653961 (+ 4440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:44.653970 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:44.653985 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:44.654581 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:44.655014 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:44.655018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:44.655021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:44.655253 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:44.655989 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:44.655996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:44.656383 (+ 387us) client_negotiation.cc:769] Sending connection context
0812 11:16:44.656642 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 11:16:44.657099 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":314,"threads_started":1}
I20260812 11:16:44.660434 17271 heartbeater.cc:347] Connected to a master server at 127.15.164.254:38283
I20260812 11:16:44.660817 17271 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:44.661825 17271 heartbeater.cc:511] Master 127.15.164.254:38283 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:16:44.664510 16970 ts_manager.cc:194] Registered new tserver with Master: 7235a7fc6bf947cbbfa90c87738fa9b9 (127.15.164.193:36877)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
I20260812 11:16:44.666599 16970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:50019
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:16:44.691627 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:45.049185 17281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:45.049532 17281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:45.049717 17281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:45.057075 17281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:45.057228 17281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:45.057425 17281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:16:45.067116 17281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:45.068439 17281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:45.069911 17281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:45.083761 17295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:45.083792 17296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:45.084079 17298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:45.084540 17281 server_base.cc:1034] running on GCE node
I20260812 11:16:45.085104 17281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:45.085992 17281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:45.087226 17281 hybrid_clock.cc:648] HybridClock initialized: now 1786533405087133 us; error 61 us; skew 500 ppm
I20260812 11:16:45.087523 17281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:45 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:45.090854 17281 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:16:45.092335 17281 webserver.cc:460] Webserver started at http://127.15.164.194:42235/ using document root <none> and password file <none>
I20260812 11:16:45.093050 17281 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:45.093205 17281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:45.093532 17281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:45.096487 17281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "ef79906fdda141bcabd7f784b12f9060"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "1cabc3db15070cefc3bd06076809fc7c"
server_key_iv: "2ccbc91ed30b5162e78155558351d7e3"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.097292 17281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "ef79906fdda141bcabd7f784b12f9060"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "1cabc3db15070cefc3bd06076809fc7c"
server_key_iv: "2ccbc91ed30b5162e78155558351d7e3"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.102576 17281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:16:45.106186 17308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.107563 17281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:16:45.107865 17281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "ef79906fdda141bcabd7f784b12f9060"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "1cabc3db15070cefc3bd06076809fc7c"
server_key_iv: "2ccbc91ed30b5162e78155558351d7e3"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.108076 17281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:45.140904 17281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:45.145522 17281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:45.145849 17281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:45.146932 17281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:45.148330 17281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:45.148437 17281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.148595 17281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:45.148671 17281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.183684 17281 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:42809
I20260812 11:16:45.183733 17491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:42809 every 8 connection(s)
I20260812 11:16:45.185061 17281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:16:45.193151 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17281
I20260812 11:16:45.193367 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:16:45.193815 16019 external_mini_cluster.cc:1428] Setting key 3681e9f13f2d26c5e9972c2d4223d656
Aug 12 11:16:45 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:45.207099 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.187884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:38927 (local address 127.15.164.254:38283)
0812 11:16:45.188383 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.188387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.189188 (+ 801us) server_negotiation.cc:407] Connection header received
0812 11:16:45.191118 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.191124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.191222 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.191349 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:45.192861 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.193744 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.195862 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.196495 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.196636 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.200499 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:45.200508 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:45.200516 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:45.200562 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:45.203726 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.204696 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.204700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.204702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.204845 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.205338 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.205341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.205343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.205604 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:45.205713 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.206640 (+ 927us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.206825 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":272,"threads_started":1}
I20260812 11:16:45.208782 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.188291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:38283 (local address 127.15.164.194:38927)
0812 11:16:45.189011 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:45.189050 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:45.190839 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:45.191592 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:45.191599 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:45.192132 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:45.192676 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.192703 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.193935 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.193940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.195722 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.195738 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.196759 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.196765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.196958 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.197676 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:45.197712 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:45.200249 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:45.203868 (+ 3619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:45.203881 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:45.203901 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:45.204563 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:45.204957 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:45.204965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:45.204972 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:45.205224 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:45.205739 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:45.205750 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:45.206208 (+ 458us) client_negotiation.cc:769] Sending connection context
0812 11:16:45.206548 (+ 340us) client_negotiation.cc:240] Negotiation successful
0812 11:16:45.207180 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":277,"threads_started":1}
I20260812 11:16:45.210532 17492 heartbeater.cc:347] Connected to a master server at 127.15.164.254:38283
I20260812 11:16:45.210861 17492 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:45.211716 17492 heartbeater.cc:511] Master 127.15.164.254:38283 requested a full tablet report, sending...
I20260812 11:16:45.213403 16970 ts_manager.cc:194] Registered new tserver with Master: ef79906fdda141bcabd7f784b12f9060 (127.15.164.194:42809)
I20260812 11:16:45.214669 16970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:38927
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:16:45.242354 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:45.582674 17499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:45.582985 17499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:45.583086 17499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:45.590404 17499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:45.590564 17499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:45.590693 17499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:16:45.600770 17499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:38283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:45.602089 17499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:45.603678 17499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:45.618377 17505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:45.618491 17507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:45.618346 17510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:45.619861 17499 server_base.cc:1034] running on GCE node
I20260812 11:16:45.620693 17499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:45.621742 17499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:45.623067 17499 hybrid_clock.cc:648] HybridClock initialized: now 1786533405622986 us; error 57 us; skew 500 ppm
I20260812 11:16:45.623598 17499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:45 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:45.627125 17499 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:16:45.628798 17499 webserver.cc:460] Webserver started at http://127.15.164.195:41525/ using document root <none> and password file <none>
I20260812 11:16:45.629532 17499 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:45.629669 17499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:45.630038 17499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:45.633123 17499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "4669cc658d66456b8d072f074293a9ee"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "c78e756dcbbe84ef240af8cf5f2bc5dc"
server_key_iv: "aeb89a20bdc6edffeacae1b96d1c5d22"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.633963 17499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "4669cc658d66456b8d072f074293a9ee"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "c78e756dcbbe84ef240af8cf5f2bc5dc"
server_key_iv: "aeb89a20bdc6edffeacae1b96d1c5d22"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.639446 17499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:16:45.643195 17528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.644577 17499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:45.644765 17499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "4669cc658d66456b8d072f074293a9ee"
format_stamp: "Formatted at 2026-08-12 11:16:45 on dist-test-slave-7kzw"
server_key: "c78e756dcbbe84ef240af8cf5f2bc5dc"
server_key_iv: "aeb89a20bdc6edffeacae1b96d1c5d22"
server_key_version: "encryptionkey@0"
I20260812 11:16:45.644953 17499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:45.659590 17499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:45.664238 17499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:45.664601 17499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:45.666055 17499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:16:45.667949 17499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:45.668061 17499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.668206 17499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:45.668288 17499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:45.670096 17271 heartbeater.cc:503] Master 127.15.164.254:38283 was elected leader, sending a full tablet report...
I20260812 11:16:45.703435 17708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:38347 every 8 connection(s)
I20260812 11:16:45.703449 17499 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:38347
I20260812 11:16:45.704955 17499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:16:45.712567 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17499
I20260812 11:16:45.712826 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:16:45.713270 16019 external_mini_cluster.cc:1428] Setting key eda45f47e194aec50e20d2e57501eff6
Aug 12 11:16:45 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533405, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:45.729833 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.707924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:43371 (local address 127.15.164.254:38283)
0812 11:16:45.708430 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.708434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.709758 (+ 1324us) server_negotiation.cc:407] Connection header received
0812 11:16:45.712199 (+ 2441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.712205 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.712309 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.712447 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:45.714560 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.715489 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.717411 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.717874 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.718029 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.723039 (+ 5010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:45.723046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:45.723051 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:45.723096 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:45.726254 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.727135 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.727140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.727144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.727340 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.727845 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.727850 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.727853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.728270 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:45.728440 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.729201 (+ 761us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.729436 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":262,"threads_started":1}
I20260812 11:16:45.730923 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.708566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:38283 (local address 127.15.164.195:43371)
0812 11:16:45.709562 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:45.709610 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:45.711844 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:45.712828 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:45.712838 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:45.713552 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:45.714350 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.714370 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.715691 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.715696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.717242 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.717255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.718132 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.718141 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.718407 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.719184 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:45.719220 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:45.722763 (+ 3543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:45.726410 (+ 3647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:45.726418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:45.726434 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:45.726991 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:45.727464 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:45.727467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:45.727470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:45.727674 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:45.728408 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:45.728416 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:45.728812 (+ 396us) client_negotiation.cc:769] Sending connection context
0812 11:16:45.729090 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 11:16:45.729650 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":364,"threads_started":1}
I20260812 11:16:45.732401 17710 heartbeater.cc:347] Connected to a master server at 127.15.164.254:38283
I20260812 11:16:45.732685 17710 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:45.733543 17710 heartbeater.cc:511] Master 127.15.164.254:38283 requested a full tablet report, sending...
I20260812 11:16:45.735143 16970 ts_manager.cc:194] Registered new tserver with Master: 4669cc658d66456b8d072f074293a9ee (127.15.164.195:38347)
I20260812 11:16:45.736007 16970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:43371
I20260812 11:16:45.741640 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:16:45.761744 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.748445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58712 (local address 127.15.164.254:38283)
0812 11:16:45.748622 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.748627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.749194 (+ 567us) server_negotiation.cc:407] Connection header received
0812 11:16:45.749398 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.749403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.749482 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.749614 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:45.751452 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.752194 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.753424 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.753868 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.753967 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.756250 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:45.756255 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:45.756258 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:45.756290 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:45.759223 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.759857 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.759862 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.759864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.759996 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:45.760337 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:45.760341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:45.760343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:45.760661 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:45.760877 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.761177 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.761343 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:16:45.768404 16970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:45.776055 16970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:45.806241 17730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.789530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:36877 (local address 127.0.0.1:37188)
0812 11:16:45.791568 (+ 2038us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:45.791593 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:45.791737 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:45.793290 (+ 1553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:45.793299 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:45.793341 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:45.794120 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.794138 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.797306 (+ 3168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.797317 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.801188 (+ 3871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.801214 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.804599 (+ 3385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.804610 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.804973 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.805065 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 11:16:45.805244 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 11:16:45.805500 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1847,"thread_start_us":1664,"threads_started":1}
I20260812 11:16:45.806979 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.790191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37188 (local address 127.15.164.193:36877)
0812 11:16:45.792472 (+ 2281us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.792484 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.792534 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:16:45.792664 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.792677 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.792987 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.794443 (+ 1456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:45.794797 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.797075 (+ 2278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.801665 (+ 4590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.804243 (+ 2578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.805809 (+ 1566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.806068 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.806179 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.806595 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2058,"thread_start_us":1868,"threads_started":1}
I20260812 11:16:45.807005 17729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.789333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42809 (local address 127.0.0.1:51628)
0812 11:16:45.790415 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:45.790505 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:45.790778 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:45.793218 (+ 2440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:45.793230 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:45.793275 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:45.793929 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.793951 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.799568 (+ 5617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.799577 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.802561 (+ 2984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.802584 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.806135 (+ 3551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.806144 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.806336 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.806368 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:16:45.806442 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:16:45.806634 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":4,"thread_start_us":533,"threads_started":1}
I20260812 11:16:45.808063 17732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.789551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.15.164.194:42809)
0812 11:16:45.792503 (+ 2952us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.792513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.792560 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:16:45.792680 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.792687 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.792933 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.795425 (+ 2492us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:45.795729 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.799366 (+ 3637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.804146 (+ 4780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.805832 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.806773 (+ 941us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.806968 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.807425 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.807622 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2774,"thread_start_us":2906,"threads_started":1}
I20260812 11:16:45.811667 17168 tablet_service.cc:1467] Processing CreateTablet for tablet 4b0613516546447badec6424f13ba1e4 (DEFAULT_TABLE table=test-table [id=5087cf50a0f14b72a8f152f111dad5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:45.812014 17391 tablet_service.cc:1467] Processing CreateTablet for tablet 4b0613516546447badec6424f13ba1e4 (DEFAULT_TABLE table=test-table [id=5087cf50a0f14b72a8f152f111dad5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:45.813436 17391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b0613516546447badec6424f13ba1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:45.813416 17168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b0613516546447badec6424f13ba1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:45.816026 17736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.792299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38347 (local address 127.0.0.1:60598)
0812 11:16:45.805632 (+ 13333us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:45.805654 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:45.805794 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:45.807316 (+ 1522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:45.807322 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:45.807354 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:45.807746 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.807762 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.810451 (+ 2689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.810457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.812863 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:45.812881 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.815218 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.815225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:45.815418 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.815455 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:16:45.815551 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:16:45.815682 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13178,"thread_start_us":13011,"threads_started":1}
I20260812 11:16:45.816867 17740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:45.792744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60598 (local address 127.15.164.195:38347)
0812 11:16:45.805140 (+ 12396us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:45.805149 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:45.806155 (+ 1006us) server_negotiation.cc:407] Connection header received
0812 11:16:45.806279 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:45.806287 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:45.806891 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:45.807123 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:45.808427 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.810256 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.813113 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:45.814694 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:45.814888 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:45.815069 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:45.816333 (+ 1264us) server_negotiation.cc:299] Negotiation successful
0812 11:16:45.816508 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12177,"thread_start_us":13127,"threads_started":1}
I20260812 11:16:45.821466 17602 tablet_service.cc:1467] Processing CreateTablet for tablet 4b0613516546447badec6424f13ba1e4 (DEFAULT_TABLE table=test-table [id=5087cf50a0f14b72a8f152f111dad5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:45.823120 17602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b0613516546447badec6424f13ba1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:45.827258 17742 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Bootstrap starting.
I20260812 11:16:45.829103 17744 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Bootstrap starting.
I20260812 11:16:45.831688 17742 tablet_bootstrap.cc:654] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:45.832718 17744 tablet_bootstrap.cc:654] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:45.833081 17742 log.cc:824] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:45.834052 17744 log.cc:824] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:45.836658 17742 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: No bootstrap required, opened a new log
I20260812 11:16:45.837013 17742 ts_tablet_manager.cc:1397] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 11:16:45.837369 17744 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: No bootstrap required, opened a new log
I20260812 11:16:45.837682 17744 ts_tablet_manager.cc:1397] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260812 11:16:45.838792 17751 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Bootstrap starting.
I20260812 11:16:45.842770 17751 tablet_bootstrap.cc:654] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:45.844105 17751 log.cc:824] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:45.847476 17751 tablet_bootstrap.cc:492] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: No bootstrap required, opened a new log
I20260812 11:16:45.847393 17742 raft_consensus.cc:348] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.847750 17751 ts_tablet_manager.cc:1397] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260812 11:16:45.847887 17742 raft_consensus.cc:374] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:45.847993 17742 raft_consensus.cc:729] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef79906fdda141bcabd7f784b12f9060, State: Initialized, Role: FOLLOWER
I20260812 11:16:45.847689 17744 raft_consensus.cc:348] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.848181 17744 raft_consensus.cc:374] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:45.848344 17744 raft_consensus.cc:729] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7235a7fc6bf947cbbfa90c87738fa9b9, State: Initialized, Role: FOLLOWER
I20260812 11:16:45.848822 17742 consensus_queue.cc:260] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.849061 17744 consensus_queue.cc:260] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.850286 17492 heartbeater.cc:503] Master 127.15.164.254:38283 was elected leader, sending a full tablet report...
I20260812 11:16:45.850755 17742 ts_tablet_manager.cc:1428] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260812 11:16:45.853338 17744 ts_tablet_manager.cc:1428] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260812 11:16:45.858036 17751 raft_consensus.cc:348] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.858397 17751 raft_consensus.cc:374] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:45.858522 17751 raft_consensus.cc:729] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4669cc658d66456b8d072f074293a9ee, State: Initialized, Role: FOLLOWER
I20260812 11:16:45.859172 17751 consensus_queue.cc:260] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:45.860342 17710 heartbeater.cc:503] Master 127.15.164.254:38283 was elected leader, sending a full tablet report...
I20260812 11:16:45.860682 17751 ts_tablet_manager.cc:1428] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Time spent starting tablet: real 0.013s user 0.007s sys 0.006s
W20260812 11:16:45.885581 17272 tablet.cc:2369] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:16:45.937223 17493 tablet.cc:2369] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:16:45.956698 17712 tablet.cc:2369] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:46.183773 17755 raft_consensus.cc:482] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:46.184186 17755 raft_consensus.cc:504] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:46.186271 17755 leader_election.cc:288] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7235a7fc6bf947cbbfa90c87738fa9b9 (127.15.164.193:36877), 4669cc658d66456b8d072f074293a9ee (127.15.164.195:38347)
I20260812 11:16:46.196221 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.186965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:45661 (local address 127.15.164.193:36877)
0812 11:16:46.187281 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.187289 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.189651 (+ 2362us) server_negotiation.cc:407] Connection header received
0812 11:16:46.189891 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.189895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.189962 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.190077 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:46.190699 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.191666 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.193613 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.194870 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.195107 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.195199 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.195524 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.195977 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 11:16:46.196447 17740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.187462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:47771 (local address 127.15.164.195:38347)
0812 11:16:46.187629 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.187635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.188788 (+ 1153us) server_negotiation.cc:407] Connection header received
0812 11:16:46.189049 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.189058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.189163 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.189278 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:46.190101 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.191195 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.193930 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.195306 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.195519 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.195653 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.196032 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.196164 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:16:46.196637 17765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.186736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38347 (local address 127.15.164.194:47771)
0812 11:16:46.188652 (+ 1916us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:46.188670 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:46.188878 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:46.189447 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:46.189452 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:46.189484 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:46.189918 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:46.189929 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.191349 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.191354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:46.193745 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:46.193763 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.195701 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.195710 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:46.195849 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.195873 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:16:46.195995 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 11:16:46.196130 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1793,"mutex_wait_us":2,"thread_start_us":2380,"threads_started":1}
I20260812 11:16:46.196928 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.186794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:36877 (local address 127.15.164.194:45661)
0812 11:16:46.189527 (+ 2733us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:46.189548 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:46.189716 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:46.190086 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:46.190090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:46.190112 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:46.190501 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:46.190511 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.191809 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.191818 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:46.193431 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:46.193445 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.195113 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.195120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:46.195322 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.195362 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:16:46.196402 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0812 11:16:46.196540 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2585,"thread_start_us":1256,"threads_started":1}
I20260812 11:16:46.197654 17635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b0613516546447badec6424f13ba1e4" candidate_uuid: "ef79906fdda141bcabd7f784b12f9060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4669cc658d66456b8d072f074293a9ee" is_pre_election: true
I20260812 11:16:46.198110 17635 raft_consensus.cc:2454] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef79906fdda141bcabd7f784b12f9060 in term 0.
I20260812 11:16:46.198809 17311 leader_election.cc:302] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4669cc658d66456b8d072f074293a9ee, ef79906fdda141bcabd7f784b12f9060; no voters:
I20260812 11:16:46.199286 17755 raft_consensus.cc:2781] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:46.199445 17755 raft_consensus.cc:482] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:46.199568 17755 raft_consensus.cc:3037] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:46.199334 17201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b0613516546447badec6424f13ba1e4" candidate_uuid: "ef79906fdda141bcabd7f784b12f9060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" is_pre_election: true
I20260812 11:16:46.199921 17201 raft_consensus.cc:2454] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef79906fdda141bcabd7f784b12f9060 in term 0.
I20260812 11:16:46.202093 17755 raft_consensus.cc:504] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:46.202811 17755 leader_election.cc:288] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [CANDIDATE]: Term 1 election: Requested vote from peers 7235a7fc6bf947cbbfa90c87738fa9b9 (127.15.164.193:36877), 4669cc658d66456b8d072f074293a9ee (127.15.164.195:38347)
I20260812 11:16:46.203375 17635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b0613516546447badec6424f13ba1e4" candidate_uuid: "ef79906fdda141bcabd7f784b12f9060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4669cc658d66456b8d072f074293a9ee"
I20260812 11:16:46.203411 17201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b0613516546447badec6424f13ba1e4" candidate_uuid: "ef79906fdda141bcabd7f784b12f9060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9"
I20260812 11:16:46.203586 17635 raft_consensus.cc:3037] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:46.203619 17201 raft_consensus.cc:3037] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:46.205862 17635 raft_consensus.cc:2454] T 4b0613516546447badec6424f13ba1e4 P 4669cc658d66456b8d072f074293a9ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef79906fdda141bcabd7f784b12f9060 in term 1.
I20260812 11:16:46.205868 17201 raft_consensus.cc:2454] T 4b0613516546447badec6424f13ba1e4 P 7235a7fc6bf947cbbfa90c87738fa9b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef79906fdda141bcabd7f784b12f9060 in term 1.
I20260812 11:16:46.206300 17312 leader_election.cc:302] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7235a7fc6bf947cbbfa90c87738fa9b9, ef79906fdda141bcabd7f784b12f9060; no voters:
I20260812 11:16:46.206686 17755 raft_consensus.cc:2781] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:46.207196 17755 raft_consensus.cc:686] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [term 1 LEADER]: Becoming Leader. State: Replica: ef79906fdda141bcabd7f784b12f9060, State: Running, Role: LEADER
I20260812 11:16:46.207744 17755 consensus_queue.cc:237] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } }
I20260812 11:16:46.212790 16970 catalog_manager.cc:5495] T 4b0613516546447badec6424f13ba1e4 P ef79906fdda141bcabd7f784b12f9060 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef79906fdda141bcabd7f784b12f9060 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "ef79906fdda141bcabd7f784b12f9060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef79906fdda141bcabd7f784b12f9060" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7235a7fc6bf947cbbfa90c87738fa9b9" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4669cc658d66456b8d072f074293a9ee" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38347 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:46.265758 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.249084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.15.164.193:36877)
0812 11:16:46.249289 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.249293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.250032 (+ 739us) server_negotiation.cc:407] Connection header received
0812 11:16:46.250246 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.250256 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.250352 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.250465 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.252239 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.252991 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.254278 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.254813 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.254949 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.259543 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.259562 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.259581 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.259654 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.263129 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.263764 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.263772 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.263775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.263918 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.264329 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.264334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.264336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.264769 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.265016 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.265276 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.265446 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:46.317548 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.302369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.15.164.193:36877)
0812 11:16:46.302653 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.302661 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.302902 (+ 241us) server_negotiation.cc:407] Connection header received
0812 11:16:46.303117 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.303123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.303254 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.303372 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.304705 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.305440 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.306782 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.307283 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.307400 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.312012 (+ 4612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.312018 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.312021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.312054 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.314863 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.315546 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.315551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.315553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.315697 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.316113 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.316118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.316120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.316392 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.316663 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.316963 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.317210 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:46.367849 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.353658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37214 (local address 127.15.164.193:36877)
0812 11:16:46.353872 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.353881 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.354253 (+ 372us) server_negotiation.cc:407] Connection header received
0812 11:16:46.354495 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.354503 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.354598 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.354716 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.356045 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.356738 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.358012 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.358435 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.358636 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.362730 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.362735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.362739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.362773 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.365108 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.365761 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.365790 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.365793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.365927 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.366314 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.366320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.366323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.366677 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.366963 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.367262 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.367508 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 11:16:46.369803 17143 tablet_service.cc:2908] Rejecting scan request for tablet 4b0613516546447badec6424f13ba1e4: Uninitialized: clean time has not yet been initialized
I20260812 11:16:46.373037 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17071
I20260812 11:16:46.385190 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.373988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37216 (local address 127.15.164.193:36877)
0812 11:16:46.374219 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.374225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.374504 (+ 279us) server_negotiation.cc:407] Connection header received
0812 11:16:46.374638 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.374642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.374702 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.374785 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.375893 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.376555 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.377645 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.378022 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.378123 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.380343 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.380348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.380351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.380379 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.382799 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.383418 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.383423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.383425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.383574 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.383911 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.383914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.383916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.384212 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.384498 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.384611 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.384773 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:16:46.386071 17266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:46.475268 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17071
I20260812 11:16:46.508960 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17281
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:16:46.524838 17787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.509877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51632 (local address 127.15.164.194:42809)
0812 11:16:46.510409 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.510413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.510431 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:16:46.510539 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.510551 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.510639 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.510732 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.512107 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.512876 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.514284 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.514884 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.514995 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.519127 (+ 4132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.519144 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.519163 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.519201 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.522167 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.522881 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.522890 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.522892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.523034 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.523399 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.523403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.523405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.523762 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.523995 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.524238 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.524408 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":256,"threads_started":1}
I20260812 11:16:46.525556 17487 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:46.616444 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17281
I20260812 11:16:46.646454 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17499
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[16897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:16:46.662024 17740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:46.647374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60602 (local address 127.15.164.195:38347)
0812 11:16:46.647600 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:46.647606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:46.647650 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:16:46.647712 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:46.647716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:46.647786 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:46.647869 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:46.649203 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.650111 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.651581 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:46.651974 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:46.652085 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:46.656316 (+ 4231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:46.656330 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:46.656348 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:46.656389 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:46.659397 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.660113 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.660120 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.660123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.660276 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:46.660670 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:46.660673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:46.660675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:46.661017 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:46.661304 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:46.661582 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 11:16:46.661752 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:16:46.662714 17703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:46.752499 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17499
I20260812 11:16:46.775452 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16919
I20260812 11:16:46.776799 17020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:46.884804 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16919
2026-08-12T11:16:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4906 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[17799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[17799](info): set up 2 sockets
Aug 12 11:16:46 dist-test-slave-7kzw krb5kdc[17799](info): commencing operation
krb5kdc: starting...
W20260812 11:16:48.247179 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:16:48 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:16:48.454574 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39141
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:39141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:48.786526 17820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:48.786839 17820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:48.786932 17820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:48.794086 17820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:48.794200 17820 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:16:48.794243 17820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:48.794298 17820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:48.794350 17820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:48.794412 17820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:48.804922 17820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:39141
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:48.806432 17820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:48.808142 17820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:48.821360 17827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:48.821422 17830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:48.821384 17828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:48.822844 17820 server_base.cc:1034] running on GCE node
I20260812 11:16:48.823792 17820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:48.825409 17820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:48.826601 17820 hybrid_clock.cc:648] HybridClock initialized: now 1786533408826528 us; error 41 us; skew 500 ppm
I20260812 11:16:48.826969 17820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:48 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:48.830361 17820 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:16:48.832105 17820 webserver.cc:460] Webserver started at http://127.15.164.254:39939/ using document root <none> and password file <none>
I20260812 11:16:48.832897 17820 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:48.833042 17820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:48.833407 17820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:48.836675 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "e6eaa6292161480191f7f369ea8db33f"
format_stamp: "Formatted at 2026-08-12 11:16:48 on dist-test-slave-7kzw"
server_key: "d524d85e8fc15487c337f9a5d4dda5dd"
server_key_iv: "d8af5e3a42f0287d496a3a704e435a32"
server_key_version: "encryptionkey@0"
I20260812 11:16:48.837502 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "e6eaa6292161480191f7f369ea8db33f"
format_stamp: "Formatted at 2026-08-12 11:16:48 on dist-test-slave-7kzw"
server_key: "d524d85e8fc15487c337f9a5d4dda5dd"
server_key_iv: "d8af5e3a42f0287d496a3a704e435a32"
server_key_version: "encryptionkey@0"
I20260812 11:16:48.843178 17820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:16:48.846737 17843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:48.848114 17820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:16:48.848335 17820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "e6eaa6292161480191f7f369ea8db33f"
format_stamp: "Formatted at 2026-08-12 11:16:48 on dist-test-slave-7kzw"
server_key: "d524d85e8fc15487c337f9a5d4dda5dd"
server_key_iv: "d8af5e3a42f0287d496a3a704e435a32"
server_key_version: "encryptionkey@0"
I20260812 11:16:48.848579 17820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:48.863152 17820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:48.867719 17820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:48.868024 17820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:48.891511 17820 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:39141
I20260812 11:16:48.891533 17939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:39141 every 8 connection(s)
I20260812 11:16:48.893060 17820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:48.894989 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17820
I20260812 11:16:48.895277 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:16:48.896184 16019 external_mini_cluster.cc:1428] Setting key ff0ef274a5eb7eade91dd38ffef78ff7
I20260812 11:16:48.898209 17940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:48.909991 17940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Bootstrap starting.
Aug 12 11:16:48 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:48.913314 17940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:48.914358 17940 log.cc:824] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:48.917922 17940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: No bootstrap required, opened a new log
I20260812 11:16:48.920231 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:48.898449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.15.164.254:39141)
0812 11:16:48.899313 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:48.899325 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:48.899367 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:16:48.900991 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:48.901014 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:48.901414 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:48.901825 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:48.903364 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:48.904725 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:48.905977 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:48.906748 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:48.906962 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:48.911576 (+ 4614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:48.911586 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:48.911771 (+ 185us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:48.911838 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:48.915755 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:48.916698 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:48.916705 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:48.916711 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:48.916910 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:48.917429 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:48.917433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:48.917435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:48.917963 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:48.918353 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:48.918832 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 11:16:48.919256 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":366,"threads_started":1}
I20260812 11:16:48.926044 17940 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } }
I20260812 11:16:48.926443 17940 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:48.926612 17940 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6eaa6292161480191f7f369ea8db33f, State: Initialized, Role: FOLLOWER
I20260812 11:16:48.927127 17940 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } }
I20260812 11:16:48.927349 17940 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:48.927446 17940 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:48.927587 17940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:48.929690 17940 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } }
I20260812 11:16:48.930146 17940 leader_election.cc:302] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6eaa6292161480191f7f369ea8db33f; no voters:
I20260812 11:16:48.930843 17940 leader_election.cc:288] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:48.930962 17951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:48.932163 17951 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [term 1 LEADER]: Becoming Leader. State: Replica: e6eaa6292161480191f7f369ea8db33f, State: Running, Role: LEADER
I20260812 11:16:48.932663 17951 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } }
I20260812 11:16:48.933107 17940 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:48.935925 17952 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6eaa6292161480191f7f369ea8db33f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } } }
I20260812 11:16:48.935890 17955 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6eaa6292161480191f7f369ea8db33f. Latest consensus state: current_term: 1 leader_uuid: "e6eaa6292161480191f7f369ea8db33f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6eaa6292161480191f7f369ea8db33f" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39141 } } }
I20260812 11:16:48.936376 17955 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:48.936378 17952 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:48.938087 17968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:48.943616 17968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:48.953109 17968 catalog_manager.cc:1347] Generated new cluster ID: f9bf20fb0cd841c399fbbb9502a20604
I20260812 11:16:48.953337 17968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:48.962716 17968 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:48.964174 17968 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:48.982493 17968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Generated new TSK 0
I20260812 11:16:48.983480 17968 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:16:49.040129 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39141
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:49.410907 17988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:49.411216 17988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:49.411418 17988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:49.419348 17988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:49.419463 17988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:49.419631 17988 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:49.419749 17988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:16:49.429714 17988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:39141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:49.431147 17988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:49.432556 17988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:49.446969 17994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:49.447125 17998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:49.447351 17995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:49.448199 17988 server_base.cc:1034] running on GCE node
I20260812 11:16:49.448943 17988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:49.449954 17988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:49.451215 17988 hybrid_clock.cc:648] HybridClock initialized: now 1786533409451149 us; error 38 us; skew 500 ppm
I20260812 11:16:49.451563 17988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:49 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533409, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:49.458254 17988 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:16:49.459913 17988 webserver.cc:460] Webserver started at http://127.15.164.193:46453/ using document root <none> and password file <none>
I20260812 11:16:49.460661 17988 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:49.460804 17988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:49.461154 17988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:49.464191 17988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
format_stamp: "Formatted at 2026-08-12 11:16:49 on dist-test-slave-7kzw"
server_key: "175a5747cd49e33f61b90a72cbbac0d7"
server_key_iv: "1f9c159c04d53ddebdabae491821e3ca"
server_key_version: "encryptionkey@0"
I20260812 11:16:49.465036 17988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
format_stamp: "Formatted at 2026-08-12 11:16:49 on dist-test-slave-7kzw"
server_key: "175a5747cd49e33f61b90a72cbbac0d7"
server_key_iv: "1f9c159c04d53ddebdabae491821e3ca"
server_key_version: "encryptionkey@0"
I20260812 11:16:49.470348 17988 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:16:49.473989 18010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:49.475558 17988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:16:49.475765 17988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
format_stamp: "Formatted at 2026-08-12 11:16:49 on dist-test-slave-7kzw"
server_key: "175a5747cd49e33f61b90a72cbbac0d7"
server_key_iv: "1f9c159c04d53ddebdabae491821e3ca"
server_key_version: "encryptionkey@0"
I20260812 11:16:49.476013 17988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:49.493355 17988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:49.497664 17988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:49.497973 17988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:49.500922 17988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:49.501019 17988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:49.501225 17988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:49.501295 17988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:49 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533409, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:49.526909 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:49.501747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35705 (local address 127.15.164.254:39141)
0812 11:16:49.502368 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:49.502375 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:49.503630 (+ 1255us) server_negotiation.cc:407] Connection header received
0812 11:16:49.505705 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:49.505716 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:49.505829 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:49.506006 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:49.508293 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.509923 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.512653 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.513064 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.513210 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:49.518220 (+ 5010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:49.518226 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:49.518229 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:49.518265 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:49.522766 (+ 4501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:49.523797 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:49.523803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:49.523807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:49.523998 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:49.524491 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:49.524499 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:49.524506 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:49.525013 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:49.525209 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:49.525981 (+ 772us) server_negotiation.cc:299] Negotiation successful
0812 11:16:49.526316 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":359,"threads_started":1}
I20260812 11:16:49.527885 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:49.502418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.193:35705)
0812 11:16:49.503407 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:49.503457 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:49.505351 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:49.506295 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:49.506312 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:49.507157 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:49.508052 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:49.508079 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.510123 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.510139 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:49.512452 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:49.512468 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.513338 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.513346 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:49.513669 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:49.514822 (+ 1153us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:49.514862 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:49.517959 (+ 3097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:49.522950 (+ 4991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:49.522964 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:49.522987 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:49.523634 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:49.524138 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:49.524142 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:49.524145 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:49.524350 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:49.525191 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:49.525198 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:49.525533 (+ 335us) client_negotiation.cc:769] Sending connection context
0812 11:16:49.525771 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 11:16:49.526170 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":382,"threads_started":1}
I20260812 11:16:49.553866 17988 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:43605
I20260812 11:16:49.553897 18193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:43605 every 8 connection(s)
I20260812 11:16:49.555516 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:49.535774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.193:35597)
0812 11:16:49.536881 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:49.536904 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:49.537113 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:49.537717 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:49.537722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:49.538641 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:49.539194 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:49.539214 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.540796 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.540807 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:49.543338 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:49.543361 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.544655 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.544661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:49.544836 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:49.545718 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:49.545755 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:49.547511 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:49.552350 (+ 4839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:49.552358 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:49.552365 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:49.553123 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:49.553662 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:49.553671 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:49.553679 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:49.553890 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:49.554620 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:49.554624 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:49.554812 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 11:16:49.554925 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:16:49.555174 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"thread_start_us":505,"threads_started":1}
I20260812 11:16:49.555760 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:49.536193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35597 (local address 127.15.164.254:39141)
0812 11:16:49.536452 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:49.536462 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:49.537001 (+ 539us) server_negotiation.cc:407] Connection header received
0812 11:16:49.537256 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:49.537261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:49.537361 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:49.537491 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:49.539410 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.540623 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.543596 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:49.544346 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:49.544511 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:49.547823 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:49.547831 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:49.547839 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:49.547898 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:49.552165 (+ 4267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:49.553295 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:49.553299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:49.553301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:49.553431 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:49.554060 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:49.554065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:49.554069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:49.554437 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:49.554681 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:49.555097 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 11:16:49.555376 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:16:49.555878 17988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:16:49.558213 18194 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39141
I20260812 11:16:49.558528 18194 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:49.559374 18194 heartbeater.cc:511] Master 127.15.164.254:39141 requested a full tablet report, sending...
I20260812 11:16:49.561551 17867 ts_manager.cc:194] Registered new tserver with Master: 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605)
I20260812 11:16:49.563047 17867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:35705
I20260812 11:16:49.564862 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17988
I20260812 11:16:49.565088 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:16:49.565714 16019 external_mini_cluster.cc:1428] Setting key 3d707d6de763c9154b932058e190eafd
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:16:49.614909 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39141
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:49.987218 18200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:49.987540 18200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:49.987715 18200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:49.994956 18200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:49.995070 18200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:49.995283 18200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:49.995411 18200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:16:50.005254 18200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:39141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:50.006670 18200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:50.008141 18200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:50.022362 18214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:50.022344 18213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:50.022521 18216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:50.023244 18200 server_base.cc:1034] running on GCE node
I20260812 11:16:50.023887 18200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:50.024924 18200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:50.026242 18200 hybrid_clock.cc:648] HybridClock initialized: now 1786533410026173 us; error 63 us; skew 500 ppm
I20260812 11:16:50.026695 18200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:50.030401 18200 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:16:50.032217 18200 webserver.cc:460] Webserver started at http://127.15.164.194:41619/ using document root <none> and password file <none>
I20260812 11:16:50.033118 18200 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:50.033238 18200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:50.033546 18200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:50.036885 18200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "92499a9e08174780a5615e90182dbf57"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "d681209b4a607547356135cb51f820e6"
server_key_iv: "af77f907b44056851e1ae824005be959"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.037890 18200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "92499a9e08174780a5615e90182dbf57"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "d681209b4a607547356135cb51f820e6"
server_key_iv: "af77f907b44056851e1ae824005be959"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.044152 18200 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:16:50.048362 18227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:50.050028 18200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:16:50.050267 18200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "92499a9e08174780a5615e90182dbf57"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "d681209b4a607547356135cb51f820e6"
server_key_iv: "af77f907b44056851e1ae824005be959"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.050678 18200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:50.068413 18200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:50.073659 18200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:50.074004 18200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:50.077056 18200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:50.077147 18200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:50.077317 18200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:50.077426 18200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:50.107126 18243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.078854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.194:32775)
0812 11:16:50.079835 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.079896 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.082048 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.083019 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.083038 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.084148 (+ 1110us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:50.085467 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.085500 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.087175 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.087179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.089688 (+ 2509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.089702 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.090917 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.090926 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.091392 (+ 466us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.092475 (+ 1083us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:50.092522 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:50.096740 (+ 4218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:50.101251 (+ 4511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.101262 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.101288 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.102060 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.102661 (+ 601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.102669 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.102673 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.103037 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.103883 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:50.103896 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:50.104397 (+ 501us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.104828 (+ 431us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.105489 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":416,"threads_started":1}
I20260812 11:16:50.107753 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.078041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:32775 (local address 127.15.164.254:39141)
0812 11:16:50.078645 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.078650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.080029 (+ 1379us) server_negotiation.cc:407] Connection header received
0812 11:16:50.082376 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.082381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.082518 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.082654 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:50.085763 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.086931 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.089860 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.090618 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.090783 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.097072 (+ 6289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:50.097081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:50.097089 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:50.097144 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:50.101076 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.102224 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.102233 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.102240 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.102442 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.103222 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.103231 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.103237 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.103696 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:50.103885 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.106834 (+ 2949us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.107173 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":339,"threads_started":1}
I20260812 11:16:50.128499 18200 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:40799
I20260812 11:16:50.128510 18420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:40799 every 8 connection(s)
I20260812 11:16:50.130323 18200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:16:50.132292 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.114646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:49035 (local address 127.15.164.254:39141)
0812 11:16:50.114864 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.114872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.116133 (+ 1261us) server_negotiation.cc:407] Connection header received
0812 11:16:50.116398 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.116402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.116471 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.116587 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:50.118308 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.119140 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.121203 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.121962 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.122128 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.124349 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:50.124355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:50.124362 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:50.124411 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:50.128527 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.129470 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.129475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.129478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.129626 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.130103 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.130110 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.130113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.130539 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:50.130715 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.131730 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.131966 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 11:16:50.132211 18380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.114650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.194:49035)
0812 11:16:50.115996 (+ 1346us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.116021 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.116213 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.116626 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.116631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.117556 (+ 925us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:50.118119 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.118132 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.119321 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.119327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.121009 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.121033 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.122212 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.122220 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.122483 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.123373 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:50.123391 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:50.124113 (+ 722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:50.128721 (+ 4608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.128727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.128732 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.129283 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.129760 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.129765 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.129769 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.129952 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.130676 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:50.130681 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:50.130976 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.131231 (+ 255us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.131688 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":455,"threads_started":1}
I20260812 11:16:50.133005 18422 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39141
I20260812 11:16:50.133334 18422 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:50.134261 18422 heartbeater.cc:511] Master 127.15.164.254:39141 requested a full tablet report, sending...
I20260812 11:16:50.135906 17867 ts_manager.cc:194] Registered new tserver with Master: 92499a9e08174780a5615e90182dbf57 (127.15.164.194:40799)
I20260812 11:16:50.136932 17867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:32775
I20260812 11:16:50.138782 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18200
I20260812 11:16:50.139062 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:16:50.139509 16019 external_mini_cluster.cc:1428] Setting key fcab0ab1604a5f6d1f4b1fe17bd20acc
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:16:50.186789 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39141
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:50.545080 18431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:50.545397 18431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:50.545572 18431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:50.553205 18431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:50.553360 18431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:50.553525 18431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:50.553674 18431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:16:50.563947 18431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:39141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:50.565248 18431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:50.566026 18194 heartbeater.cc:503] Master 127.15.164.254:39141 was elected leader, sending a full tablet report...
I20260812 11:16:50.567001 18431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:50.581264 18444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:50.581300 18443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:50.581516 18448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:50.582093 18431 server_base.cc:1034] running on GCE node
I20260812 11:16:50.582855 18431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:50.583832 18431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:50.585091 18431 hybrid_clock.cc:648] HybridClock initialized: now 1786533410585019 us; error 42 us; skew 500 ppm
I20260812 11:16:50.585415 18431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:50.588862 18431 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:16:50.590592 18431 webserver.cc:460] Webserver started at http://127.15.164.195:35963/ using document root <none> and password file <none>
I20260812 11:16:50.591360 18431 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:50.591506 18431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:50.591866 18431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:50.595010 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "e8963d419dce49ce8776c8d9b57a1224"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "add636d8d9773fcf7aad7d56c5b47e32"
server_key_iv: "e473d70e4fceb5fc253b19b08ca613fc"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.595856 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "e8963d419dce49ce8776c8d9b57a1224"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "add636d8d9773fcf7aad7d56c5b47e32"
server_key_iv: "e473d70e4fceb5fc253b19b08ca613fc"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.601382 18431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:16:50.605162 18458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:50.606943 18431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:16:50.607164 18431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "e8963d419dce49ce8776c8d9b57a1224"
format_stamp: "Formatted at 2026-08-12 11:16:50 on dist-test-slave-7kzw"
server_key: "add636d8d9773fcf7aad7d56c5b47e32"
server_key_iv: "e473d70e4fceb5fc253b19b08ca613fc"
server_key_version: "encryptionkey@0"
I20260812 11:16:50.607448 18431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:50.644587 18431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:50.649300 18431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:50.649600 18431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:50.652626 18431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:50.652736 18431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:50.652894 18431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:50.652982 18431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:50.678529 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.653317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:37315 (local address 127.15.164.254:39141)
0812 11:16:50.653979 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.653983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.655152 (+ 1169us) server_negotiation.cc:407] Connection header received
0812 11:16:50.657646 (+ 2494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.657655 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.657777 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.657918 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:50.660942 (+ 3024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.662043 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.664502 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.665171 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.665315 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.670707 (+ 5392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:50.670715 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:50.670720 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:50.670769 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:50.674540 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.675650 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.675656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.675660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.675843 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.676534 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.676541 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.676547 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.676924 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:50.677087 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.677854 (+ 767us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.678093 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":424,"threads_started":1}
I20260812 11:16:50.679919 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.653965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.195:37315)
0812 11:16:50.654965 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.655004 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.657251 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.658440 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.658454 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.659625 (+ 1171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:50.660695 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.660726 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.662235 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.662240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.664344 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.664357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.665446 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.665455 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.665683 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.666458 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:50.666583 (+ 125us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:50.670366 (+ 3783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:50.674737 (+ 4371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.674751 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.674780 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.675503 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.675992 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.675998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.676005 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.676372 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.677077 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:50.677086 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:50.677466 (+ 380us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.677751 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.678319 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":494,"threads_started":1}
I20260812 11:16:50.711993 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.694044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.15.164.195:39725)
0812 11:16:50.694806 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.694823 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.695014 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.695525 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.695534 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.696296 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:50.696789 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.696806 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.698008 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.698016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.700317 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.700346 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.701275 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.701284 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.701494 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.702326 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:50.702344 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:50.703827 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:50.708489 (+ 4662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.708496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.708500 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.709048 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.709598 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:50.709603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:50.709607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:50.709819 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:50.710665 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:50.710669 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:50.710836 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.710968 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.711486 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":493,"threads_started":1}
I20260812 11:16:50.712049 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.693966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:39725 (local address 127.15.164.254:39141)
0812 11:16:50.694196 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.694205 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.694929 (+ 724us) server_negotiation.cc:407] Connection header received
0812 11:16:50.695185 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.695190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.695327 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.695451 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:50.696968 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.697840 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.700514 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.701062 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.701170 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.704067 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:50.704077 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:50.704085 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:50.704140 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:50.708333 (+ 4193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.709258 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.709267 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.709271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.709450 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.709983 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.709988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.709991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.710502 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:50.710720 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.711176 (+ 456us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.711520 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 11:16:50.717409 18431 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:45825
I20260812 11:16:50.717433 18641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:45825 every 8 connection(s)
I20260812 11:16:50.718685 18431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:16:50.720357 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18431
I20260812 11:16:50.720594 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:16:50.720903 18643 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39141
I20260812 11:16:50.721113 16019 external_mini_cluster.cc:1428] Setting key 87fc1cf2f35d15e55087577cef9e5418
I20260812 11:16:50.721150 18643 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:50.721938 18643 heartbeater.cc:511] Master 127.15.164.254:39141 requested a full tablet report, sending...
I20260812 11:16:50.723796 17866 ts_manager.cc:194] Registered new tserver with Master: e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:50.724761 17866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:37315
I20260812 11:16:50.736630 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:16:50 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:50.789324 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.773642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.15.164.254:39141)
0812 11:16:50.773901 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.773909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.774233 (+ 324us) server_negotiation.cc:407] Connection header received
0812 11:16:50.774528 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.774540 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.774611 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.774730 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:50.776159 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.776882 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.778186 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.778686 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.778829 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.783755 (+ 4926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:50.783760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:50.783764 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:50.783803 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:50.786656 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.787351 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.787355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.787357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.787485 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:50.787853 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:50.787856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:50.787858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:50.788125 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:50.788324 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.788704 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.788884 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:16:50.794144 17866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:50.801899 17866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:50.839990 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.816773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32966 (local address 127.15.164.194:40799)
0812 11:16:50.827727 (+ 10954us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.827743 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.830736 (+ 2993us) server_negotiation.cc:407] Connection header received
0812 11:16:50.830866 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.830874 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.831102 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.831348 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:50.832608 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.834440 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.837298 (+ 2858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.838777 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.838966 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.839180 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.839495 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.839670 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10640,"thread_start_us":10990,"threads_started":1}
I20260812 11:16:50.840267 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.819969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:45825 (local address 127.0.0.1:33498)
0812 11:16:50.830797 (+ 10828us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.830817 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.830928 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.832128 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.832133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.832175 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:50.832879 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.832937 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.835071 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.835077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.837288 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.837304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.839336 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.839343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.839511 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.839548 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.839652 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.839787 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10706,"mutex_wait_us":1,"thread_start_us":10919,"threads_started":1}
I20260812 11:16:50.840493 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.816457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:40799 (local address 127.0.0.1:32966)
0812 11:16:50.830343 (+ 13886us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.830363 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.830546 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.831567 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.831575 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.831608 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:50.832367 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.832387 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.834618 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.834623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.837060 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.837077 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.839026 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.839035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.839253 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.839302 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.839447 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.839660 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13733,"mutex_wait_us":73,"thread_start_us":11805,"threads_started":1}
I20260812 11:16:50.841087 18679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.819068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.15.164.195:45825)
0812 11:16:50.831597 (+ 12529us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.831605 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.831641 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:16:50.831733 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.831737 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.831943 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.832136 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:50.833254 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.834915 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.837477 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.838920 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.839175 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.839345 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.840537 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.840719 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12337,"thread_start_us":12131,"threads_started":1}
I20260812 11:16:50.841847 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.816516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.15.164.193:43605)
0812 11:16:50.829996 (+ 13480us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:50.830008 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:50.830047 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:16:50.830165 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:50.830176 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:50.830570 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:50.830807 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:50.834674 (+ 3867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.835791 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.837991 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.839582 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.839743 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.839901 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:50.841389 (+ 1488us) server_negotiation.cc:299] Negotiation successful
0812 11:16:50.841569 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13278,"thread_start_us":13134,"threads_started":1}
I20260812 11:16:50.842554 18673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:50.816241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:43605 (local address 127.0.0.1:58070)
0812 11:16:50.828867 (+ 12626us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:50.828929 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:50.829237 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:50.831465 (+ 2228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:50.831474 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:50.831543 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:50.832383 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.832392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.835935 (+ 3543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.835944 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.837735 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:50.837751 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:50.840070 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:50.840077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:50.840289 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:50.840330 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:16:50.840730 (+ 400us) client_negotiation.cc:240] Negotiation successful
0812 11:16:50.840864 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12232,"mutex_wait_us":74,"thread_start_us":13784,"threads_started":1}
I20260812 11:16:50.844856 18533 tablet_service.cc:1467] Processing CreateTablet for tablet 166e15371bf1457b949e99757952440f (DEFAULT_TABLE table=test-table [id=ab2e2c890e8b4072ade563f51e4950f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:50.845146 18306 tablet_service.cc:1467] Processing CreateTablet for tablet 166e15371bf1457b949e99757952440f (DEFAULT_TABLE table=test-table [id=ab2e2c890e8b4072ade563f51e4950f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:50.846222 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 166e15371bf1457b949e99757952440f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:50.845947 18087 tablet_service.cc:1467] Processing CreateTablet for tablet 166e15371bf1457b949e99757952440f (DEFAULT_TABLE table=test-table [id=ab2e2c890e8b4072ade563f51e4950f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:50.846577 18306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 166e15371bf1457b949e99757952440f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:50.847313 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 166e15371bf1457b949e99757952440f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:50.858279 18681 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Bootstrap starting.
I20260812 11:16:50.861943 18684 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Bootstrap starting.
I20260812 11:16:50.862880 18681 tablet_bootstrap.cc:654] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:50.864252 18681 log.cc:824] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:50.865753 18684 tablet_bootstrap.cc:654] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:50.866655 18683 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Bootstrap starting.
I20260812 11:16:50.867336 18684 log.cc:824] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:50.868189 18681 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: No bootstrap required, opened a new log
I20260812 11:16:50.868479 18681 ts_tablet_manager.cc:1397] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 11:16:50.870229 18683 tablet_bootstrap.cc:654] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:50.871460 18683 log.cc:824] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:50.871903 18684 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: No bootstrap required, opened a new log
I20260812 11:16:50.872187 18684 ts_tablet_manager.cc:1397] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:16:50.874197 18683 tablet_bootstrap.cc:492] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: No bootstrap required, opened a new log
I20260812 11:16:50.874550 18683 ts_tablet_manager.cc:1397] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260812 11:16:50.879571 18681 raft_consensus.cc:348] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.880110 18681 raft_consensus.cc:374] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:50.880242 18681 raft_consensus.cc:729] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8963d419dce49ce8776c8d9b57a1224, State: Initialized, Role: FOLLOWER
I20260812 11:16:50.881068 18681 consensus_queue.cc:260] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.883306 18683 raft_consensus.cc:348] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.883755 18683 raft_consensus.cc:374] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:50.883859 18683 raft_consensus.cc:729] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Initialized, Role: FOLLOWER
I20260812 11:16:50.884513 18683 consensus_queue.cc:260] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.884529 18684 raft_consensus.cc:348] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.884956 18684 raft_consensus.cc:374] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:50.885088 18684 raft_consensus.cc:729] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6d02634b1d4ca7ab791d190c6d8219, State: Initialized, Role: FOLLOWER
I20260812 11:16:50.885978 18422 heartbeater.cc:503] Master 127.15.164.254:39141 was elected leader, sending a full tablet report...
I20260812 11:16:50.885839 18684 consensus_queue.cc:260] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:50.886744 18683 ts_tablet_manager.cc:1428] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 11:16:50.888164 18643 heartbeater.cc:503] Master 127.15.164.254:39141 was elected leader, sending a full tablet report...
I20260812 11:16:50.889755 18681 ts_tablet_manager.cc:1428] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Time spent starting tablet: real 0.021s user 0.010s sys 0.011s
I20260812 11:16:50.891911 18684 ts_tablet_manager.cc:1428] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent starting tablet: real 0.020s user 0.014s sys 0.004s
W20260812 11:16:50.970484 18647 tablet.cc:2369] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:16:51.059150 18195 tablet.cc:2369] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:51.092501 18690 raft_consensus.cc:482] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:51.092895 18690 raft_consensus.cc:504] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.094857 18690 leader_election.cc:288] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.102595 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.095404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:57017 (local address 127.15.164.193:43605)
0812 11:16:51.095616 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.095624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.096437 (+ 813us) server_negotiation.cc:407] Connection header received
0812 11:16:51.096664 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.096673 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.096783 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.096857 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:51.097607 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.098346 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.100588 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.101491 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.101621 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.101685 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.102138 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.102306 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:16:51.103060 18679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.095377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:44331 (local address 127.15.164.195:45825)
0812 11:16:51.095606 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.095616 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.096552 (+ 936us) server_negotiation.cc:407] Connection header received
0812 11:16:51.096790 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.096795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.096893 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.096998 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:51.097738 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.098893 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.100895 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.101888 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.102069 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.102139 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.102576 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.102843 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:16:51.103318 18694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.095392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:43605 (local address 127.15.164.194:57017)
0812 11:16:51.096312 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.096329 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.096460 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.096905 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.096910 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.096939 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:51.097436 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.097451 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.098575 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.098581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.100409 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.100423 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.101724 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.101731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.101922 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.101973 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.102072 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.102219 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":77,"thread_start_us":533,"threads_started":1}
I20260812 11:16:51.103737 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.095458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:45825 (local address 127.15.164.194:44331)
0812 11:16:51.096436 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.096463 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.096602 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.097043 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.097046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.097081 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:51.097492 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.097502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.099049 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.099053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.100691 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.100706 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.102173 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.102180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.102356 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.102390 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.102540 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.102741 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":3,"thread_start_us":500,"threads_started":1}
I20260812 11:16:51.104579 18114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e15371bf1457b949e99757952440f" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" is_pre_election: true
I20260812 11:16:51.104683 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e15371bf1457b949e99757952440f" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224" is_pre_election: true
I20260812 11:16:51.105196 18564 raft_consensus.cc:2454] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.105165 18114 raft_consensus.cc:2454] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.105952 18235 leader_election.cc:302] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92499a9e08174780a5615e90182dbf57, e8963d419dce49ce8776c8d9b57a1224; no voters:
I20260812 11:16:51.106416 18690 raft_consensus.cc:2781] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:51.106631 18690 raft_consensus.cc:482] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:51.106758 18690 raft_consensus.cc:3037] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.109119 18690 raft_consensus.cc:504] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.109964 18690 leader_election.cc:288] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Requested vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.110641 18114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e15371bf1457b949e99757952440f" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
I20260812 11:16:51.110670 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e15371bf1457b949e99757952440f" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224"
I20260812 11:16:51.110926 18564 raft_consensus.cc:3037] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.110944 18114 raft_consensus.cc:3037] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.113876 18114 raft_consensus.cc:2454] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.114037 18564 raft_consensus.cc:2454] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.114611 18232 leader_election.cc:302] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6d02634b1d4ca7ab791d190c6d8219, 92499a9e08174780a5615e90182dbf57; no voters:
I20260812 11:16:51.115017 18690 raft_consensus.cc:2781] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:51.115559 18690 raft_consensus.cc:686] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 1 LEADER]: Becoming Leader. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Running, Role: LEADER
I20260812 11:16:51.116182 18690 consensus_queue.cc:237] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.122543 17863 catalog_manager.cc:5495] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92499a9e08174780a5615e90182dbf57 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } health_report { overall_health: UNKNOWN } } }
W20260812 11:16:51.133384 18423 tablet.cc:2369] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:51.217646 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.211684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32972 (local address 127.15.164.194:40799)
0812 11:16:51.211994 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.212001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.212169 (+ 168us) server_negotiation.cc:407] Connection header received
0812 11:16:51.212543 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.212547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.212638 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.212792 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:51.213243 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.213982 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.215469 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.215870 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.215969 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.216486 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:51.217021 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:51.217135 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.217292 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.217360 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260812 11:16:51.226733 18564 raft_consensus.cc:1261] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Refusing update from remote peer 92499a9e08174780a5615e90182dbf57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:51.226740 18114 raft_consensus.cc:1261] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Refusing update from remote peer 92499a9e08174780a5615e90182dbf57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:51.227942 18698 consensus_queue.cc:1035] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.228389 18690 consensus_queue.cc:1035] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.240415 18701 mvcc.cc:205] Tried to move back new op lower bound from 7317640852372779008 to 7317640851936768000. Current Snapshot: MvccSnapshot[applied={T|T < 7317640852372779008}]
I20260812 11:16:51.263978 17866 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:51.264408 17866 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:51.269274 17866 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Sending DeleteTablet for 3 replicas of tablet 166e15371bf1457b949e99757952440f
I20260812 11:16:51.270897 18087 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e15371bf1457b949e99757952440f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:51 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58070
I20260812 11:16:51.271041 18306 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e15371bf1457b949e99757952440f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:51 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:32966
I20260812 11:16:51.271040 18533 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e15371bf1457b949e99757952440f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:51 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 11:16:51.276031 17866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:51.278049 17866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:51.286202 18714 tablet_replica.cc:330] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: stopping tablet replica
I20260812 11:16:51.287154 18714 raft_consensus.cc:2229] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:51.287883 18714 raft_consensus.cc:2258] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:51.289791 18533 tablet_service.cc:1467] Processing CreateTablet for tablet 628e6a68bb284f36a8a645d858d0af00 (DEFAULT_TABLE table=test-table [id=dde0180ade2b43568a95fe8656ae4fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:51.289919 18085 tablet_service.cc:1467] Processing CreateTablet for tablet 628e6a68bb284f36a8a645d858d0af00 (DEFAULT_TABLE table=test-table [id=dde0180ade2b43568a95fe8656ae4fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:51.289875 18304 tablet_service.cc:1467] Processing CreateTablet for tablet 628e6a68bb284f36a8a645d858d0af00 (DEFAULT_TABLE table=test-table [id=dde0180ade2b43568a95fe8656ae4fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:51.290633 18304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628e6a68bb284f36a8a645d858d0af00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.290665 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628e6a68bb284f36a8a645d858d0af00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.291807 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628e6a68bb284f36a8a645d858d0af00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.294719 18715 tablet_replica.cc:330] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: stopping tablet replica
I20260812 11:16:51.295260 18715 raft_consensus.cc:2229] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:51.295866 18715 raft_consensus.cc:2258] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:51.296753 18716 tablet_replica.cc:330] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: stopping tablet replica
I20260812 11:16:51.297171 18716 raft_consensus.cc:2229] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:16:51.297554 18683 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Bootstrap starting.
I20260812 11:16:51.297703 18684 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Bootstrap starting.
I20260812 11:16:51.299402 18683 tablet_bootstrap.cc:654] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.299413 18684 tablet_bootstrap.cc:654] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.305845 18714 ts_tablet_manager.cc:1905] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:51.308159 18684 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: No bootstrap required, opened a new log
I20260812 11:16:51.310366 18683 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: No bootstrap required, opened a new log
I20260812 11:16:51.310590 18683 ts_tablet_manager.cc:1397] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260812 11:16:51.311902 18683 raft_consensus.cc:348] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.312310 18683 raft_consensus.cc:374] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.308334 18684 ts_tablet_manager.cc:1397] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260812 11:16:51.312443 18683 raft_consensus.cc:729] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.312808 18683 consensus_queue.cc:260] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.313520 18684 raft_consensus.cc:348] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.313712 18683 ts_tablet_manager.cc:1428] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:16:51.313751 18684 raft_consensus.cc:374] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.313848 18684 raft_consensus.cc:729] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6d02634b1d4ca7ab791d190c6d8219, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.314198 18684 consensus_queue.cc:260] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.314649 18716 raft_consensus.cc:2258] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:51.317011 18715 ts_tablet_manager.cc:1905] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:51.317154 18684 ts_tablet_manager.cc:1428] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260812 11:16:51.319500 18681 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Bootstrap starting.
I20260812 11:16:51.321503 18681 tablet_bootstrap.cc:654] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.324829 18715 ts_tablet_manager.cc:1918] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:16:51.325026 18715 log.cc:1196] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/166e15371bf1457b949e99757952440f
I20260812 11:16:51.325335 18716 ts_tablet_manager.cc:1905] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:51.325644 18715 ts_tablet_manager.cc:1939] T 166e15371bf1457b949e99757952440f P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting consensus metadata
I20260812 11:16:51.327831 17848 catalog_manager.cc:4841] TS 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605): tablet 166e15371bf1457b949e99757952440f (table test-table [id=ab2e2c890e8b4072ade563f51e4950f1]) successfully deleted
I20260812 11:16:51.329923 18681 tablet_bootstrap.cc:492] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: No bootstrap required, opened a new log
I20260812 11:16:51.330157 18681 ts_tablet_manager.cc:1397] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260812 11:16:51.331223 18681 raft_consensus.cc:348] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.331485 18681 raft_consensus.cc:374] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.331617 18681 raft_consensus.cc:729] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8963d419dce49ce8776c8d9b57a1224, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.332103 18681 consensus_queue.cc:260] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.332342 18714 ts_tablet_manager.cc:1918] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:16:51.332909 18681 ts_tablet_manager.cc:1428] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:16:51.332926 18714 log.cc:1196] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/166e15371bf1457b949e99757952440f
I20260812 11:16:51.333714 18714 ts_tablet_manager.cc:1939] T 166e15371bf1457b949e99757952440f P e8963d419dce49ce8776c8d9b57a1224: Deleting consensus metadata
I20260812 11:16:51.336076 17851 catalog_manager.cc:4841] TS e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825): tablet 166e15371bf1457b949e99757952440f (table test-table [id=ab2e2c890e8b4072ade563f51e4950f1]) successfully deleted
I20260812 11:16:51.336452 18716 ts_tablet_manager.cc:1918] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:16:51.336671 18716 log.cc:1196] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/166e15371bf1457b949e99757952440f
I20260812 11:16:51.337368 18716 ts_tablet_manager.cc:1939] T 166e15371bf1457b949e99757952440f P 92499a9e08174780a5615e90182dbf57: Deleting consensus metadata
I20260812 11:16:51.339425 17845 catalog_manager.cc:4841] TS 92499a9e08174780a5615e90182dbf57 (127.15.164.194:40799): tablet 166e15371bf1457b949e99757952440f (table test-table [id=ab2e2c890e8b4072ade563f51e4950f1]) successfully deleted
I20260812 11:16:51.526307 18689 raft_consensus.cc:482] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:51.526702 18689 raft_consensus.cc:504] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.528581 18689 leader_election.cc:288] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), 92499a9e08174780a5615e90182dbf57 (127.15.164.194:40799)
I20260812 11:16:51.530719 18690 raft_consensus.cc:482] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:51.531041 18690 raft_consensus.cc:504] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.532177 18690 leader_election.cc:288] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.532778 18114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" is_pre_election: true
I20260812 11:16:51.533087 18114 raft_consensus.cc:2454] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.533636 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224" is_pre_election: true
I20260812 11:16:51.533933 18564 raft_consensus.cc:2454] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.534508 18235 leader_election.cc:302] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92499a9e08174780a5615e90182dbf57, e8963d419dce49ce8776c8d9b57a1224; no voters:
I20260812 11:16:51.535362 18690 raft_consensus.cc:2781] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:51.535530 18690 raft_consensus.cc:482] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:51.535660 18690 raft_consensus.cc:3037] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.539745 18690 raft_consensus.cc:504] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.541097 18114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
I20260812 11:16:51.541356 18114 raft_consensus.cc:3037] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.543749 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.529909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:45333 (local address 127.15.164.193:43605)
0812 11:16:51.530178 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.530187 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.533661 (+ 3474us) server_negotiation.cc:407] Connection header received
0812 11:16:51.534206 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.534216 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.534306 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.534382 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:51.535420 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.536703 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.540639 (+ 3936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.542184 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.542345 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.542448 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.543220 (+ 772us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.543395 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 11:16:51.544786 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.528863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:43605 (local address 127.15.164.195:45333)
0812 11:16:51.533514 (+ 4651us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.533539 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.533792 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.534727 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.534733 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.534779 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:51.535198 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.535215 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.537020 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.537026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.540410 (+ 3384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.540430 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.542736 (+ 2306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.542749 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.542964 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.543003 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.544205 (+ 1202us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.544375 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4490,"thread_start_us":8221,"threads_started":1}
I20260812 11:16:51.544938 18114 raft_consensus.cc:2454] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.545435 18232 leader_election.cc:302] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6d02634b1d4ca7ab791d190c6d8219, 92499a9e08174780a5615e90182dbf57; no voters:
I20260812 11:16:51.546080 18690 leader_election.cc:288] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Requested vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.546411 18690 raft_consensus.cc:2781] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:51.546712 18690 raft_consensus.cc:686] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 1 LEADER]: Becoming Leader. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Running, Role: LEADER
I20260812 11:16:51.546789 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224"
I20260812 11:16:51.547103 18564 raft_consensus.cc:3037] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.547019 18112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "e8963d419dce49ce8776c8d9b57a1224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" is_pre_election: true
I20260812 11:16:51.547556 18112 raft_consensus.cc:2379] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8963d419dce49ce8776c8d9b57a1224 in current term 1: Already voted for candidate 92499a9e08174780a5615e90182dbf57 in this term.
I20260812 11:16:51.547423 18690 consensus_queue.cc:237] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.550573 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.529279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:39601 (local address 127.15.164.194:40799)
0812 11:16:51.529557 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.529568 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.538931 (+ 9363us) server_negotiation.cc:407] Connection header received
0812 11:16:51.539303 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.539309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.539435 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.539541 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:51.540681 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.541938 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.544861 (+ 2923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.546437 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.546630 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.546722 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.550013 (+ 3291us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.550205 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:16:51.551890 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.529210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:40799 (local address 127.15.164.195:39601)
0812 11:16:51.538808 (+ 9598us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.538835 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.539060 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.539858 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.539864 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.539894 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:51.540424 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.540442 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.542203 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.542210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.544615 (+ 2405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.544636 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.549399 (+ 4763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.549419 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.549733 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.549774 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.550826 (+ 1052us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.551009 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9437,"thread_start_us":7518,"threads_started":1}
I20260812 11:16:51.552546 18564 raft_consensus.cc:2454] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.553705 17863 catalog_manager.cc:5495] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92499a9e08174780a5615e90182dbf57 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } health_report { overall_health: UNKNOWN } } }
I20260812 11:16:51.555240 18345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628e6a68bb284f36a8a645d858d0af00" candidate_uuid: "e8963d419dce49ce8776c8d9b57a1224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92499a9e08174780a5615e90182dbf57" is_pre_election: true
I20260812 11:16:51.556656 18460 leader_election.cc:302] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8963d419dce49ce8776c8d9b57a1224; no voters: 8c6d02634b1d4ca7ab791d190c6d8219, 92499a9e08174780a5615e90182dbf57
I20260812 11:16:51.557120 18689 raft_consensus.cc:2726] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 12 11:16:51 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533408, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:51.652877 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.637404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39141 (local address 127.0.0.1:36874)
0812 11:16:51.638338 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.638366 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.638591 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.639067 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.639072 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.639759 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:51.639974 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.639984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.641079 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.641086 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.642139 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.642153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.642978 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.642983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.643146 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.643890 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:51.643908 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:51.646795 (+ 2887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:51.649919 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:51.649936 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:51.649945 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:51.650384 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:51.650790 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:51.650795 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:51.650799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:51.650952 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:51.651476 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:51.651485 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:51.651716 (+ 231us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.652021 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.652346 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":435,"threads_started":1}
I20260812 11:16:51.652922 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.637465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36874 (local address 127.15.164.254:39141)
0812 11:16:51.638707 (+ 1242us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.638712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.638742 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:16:51.638794 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.638798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.638889 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.639011 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:51.640150 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.640924 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.642298 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.642792 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.642929 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.646990 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:51.646995 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:51.646999 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:51.647030 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:51.649780 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:51.650529 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:51.650537 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:51.650542 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:51.650679 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:51.651066 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:51.651071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:51.651074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:51.651346 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:51.651502 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.652126 (+ 624us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.652475 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":1075,"thread_start_us":902,"threads_started":1}
I20260812 11:16:51.659353 17863 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:36874:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:16:51.660877 17863 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:51.677142 18087 tablet_service.cc:1467] Processing CreateTablet for tablet e75d293c48804d20acbecbc68e39d794 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a2a5a756f54482c99e8911647d0843d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:51.677910 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d293c48804d20acbecbc68e39d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.681109 18533 tablet_service.cc:1467] Processing CreateTablet for tablet e75d293c48804d20acbecbc68e39d794 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a2a5a756f54482c99e8911647d0843d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:51.681125 18306 tablet_service.cc:1467] Processing CreateTablet for tablet e75d293c48804d20acbecbc68e39d794 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a2a5a756f54482c99e8911647d0843d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:51.681773 18306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d293c48804d20acbecbc68e39d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.681782 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d293c48804d20acbecbc68e39d794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:51.690119 18681 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: Bootstrap starting.
I20260812 11:16:51.691843 18681 tablet_bootstrap.cc:654] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.695118 18681 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: No bootstrap required, opened a new log
I20260812 11:16:51.695312 18681 ts_tablet_manager.cc:1397] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:16:51.696171 18681 raft_consensus.cc:348] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.696440 18681 raft_consensus.cc:374] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.696520 18681 raft_consensus.cc:729] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8963d419dce49ce8776c8d9b57a1224, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.696785 18681 consensus_queue.cc:260] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.697377 18681 ts_tablet_manager.cc:1428] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 11:16:51.697311 18689 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.697525 18684 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: Bootstrap starting.
I20260812 11:16:51.697608 18689 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.699255 18684 tablet_bootstrap.cc:654] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.702895 18683 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: Bootstrap starting.
I20260812 11:16:51.705463 18683 tablet_bootstrap.cc:654] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:51.706985 18684 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: No bootstrap required, opened a new log
I20260812 11:16:51.707226 18684 ts_tablet_manager.cc:1397] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 11:16:51.707975 18683 tablet_bootstrap.cc:492] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: No bootstrap required, opened a new log
I20260812 11:16:51.708168 18683 ts_tablet_manager.cc:1397] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 11:16:51.708069 18684 raft_consensus.cc:348] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.708367 18684 raft_consensus.cc:374] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.708468 18684 raft_consensus.cc:729] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6d02634b1d4ca7ab791d190c6d8219, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.708739 18684 consensus_queue.cc:260] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.709061 18683 raft_consensus.cc:348] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.709331 18683 raft_consensus.cc:374] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:51.709419 18683 raft_consensus.cc:729] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Initialized, Role: FOLLOWER
I20260812 11:16:51.709262 18692 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.709705 18692 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.709865 18683 consensus_queue.cc:260] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.710264 18684 ts_tablet_manager.cc:1428] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 11:16:51.710314 18690 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.710708 18690 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.711350 18683 ts_tablet_manager.cc:1428] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 11:16:51.824355 18690 raft_consensus.cc:482] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:51.824690 18690 raft_consensus.cc:504] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.825346 18690 leader_election.cc:288] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.826020 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75d293c48804d20acbecbc68e39d794" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224" is_pre_election: true
I20260812 11:16:51.826045 18112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75d293c48804d20acbecbc68e39d794" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" is_pre_election: true
I20260812 11:16:51.826294 18112 raft_consensus.cc:2454] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.826300 18564 raft_consensus.cc:2454] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 0.
I20260812 11:16:51.826810 18232 leader_election.cc:302] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6d02634b1d4ca7ab791d190c6d8219, 92499a9e08174780a5615e90182dbf57; no voters:
I20260812 11:16:51.827123 18690 raft_consensus.cc:2781] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:51.827210 18690 raft_consensus.cc:482] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:51.827350 18690 raft_consensus.cc:3037] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.829435 18690 raft_consensus.cc:504] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.830176 18690 leader_election.cc:288] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Requested vote from peers 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605), e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825)
I20260812 11:16:51.830551 18564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75d293c48804d20acbecbc68e39d794" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8963d419dce49ce8776c8d9b57a1224"
I20260812 11:16:51.830691 18112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75d293c48804d20acbecbc68e39d794" candidate_uuid: "92499a9e08174780a5615e90182dbf57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6d02634b1d4ca7ab791d190c6d8219"
I20260812 11:16:51.830808 18564 raft_consensus.cc:3037] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.830941 18112 raft_consensus.cc:3037] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:51.833760 18564 raft_consensus.cc:2454] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.833858 18112 raft_consensus.cc:2454] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92499a9e08174780a5615e90182dbf57 in term 1.
I20260812 11:16:51.834257 18232 leader_election.cc:302] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8c6d02634b1d4ca7ab791d190c6d8219, 92499a9e08174780a5615e90182dbf57, e8963d419dce49ce8776c8d9b57a1224; no voters:
I20260812 11:16:51.834650 18690 raft_consensus.cc:2781] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:51.834877 18690 raft_consensus.cc:686] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [term 1 LEADER]: Becoming Leader. State: Replica: 92499a9e08174780a5615e90182dbf57, State: Running, Role: LEADER
I20260812 11:16:51.835420 18690 consensus_queue.cc:237] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } }
I20260812 11:16:51.837906 18698 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: TxnStatusTablet state changed. Reason: New leader 92499a9e08174780a5615e90182dbf57. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.838168 18698 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:51.838974 18749 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:16:51.839313 18749 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:16:51.839979 17866 catalog_manager.cc:5495] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92499a9e08174780a5615e90182dbf57 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } health_report { overall_health: UNKNOWN } } }
I20260812 11:16:51.891083 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.884740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:40799 (local address 127.0.0.1:32986)
0812 11:16:51.884999 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.885020 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.885153 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.885656 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.885661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.885674 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:51.885876 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.885895 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.887430 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.887434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.888458 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.888471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.889729 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.889734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.889890 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.889958 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:51.890413 (+ 455us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:51.890429 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.890571 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.890770 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:16:51.891072 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.884908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.15.164.194:40799)
0812 11:16:51.885120 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.885126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.885159 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:16:51.885337 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.885343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.885439 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.885570 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:51.886033 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.887252 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.888611 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.889544 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.889683 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.890171 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:51.890304 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:51.890407 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.890608 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.890699 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:16:51.896391 18564 raft_consensus.cc:1261] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Refusing update from remote peer 92499a9e08174780a5615e90182dbf57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:51.896493 18112 raft_consensus.cc:1261] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Refusing update from remote peer 92499a9e08174780a5615e90182dbf57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:51.897060 18698 consensus_queue.cc:1035] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.897624 18690 consensus_queue.cc:1035] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.917083 18692 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: TxnStatusTablet state changed. Reason: New leader 92499a9e08174780a5615e90182dbf57. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.917483 18692 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.918282 18689 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: TxnStatusTablet state changed. Reason: New leader 92499a9e08174780a5615e90182dbf57. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.918634 18689 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.923261 18753 mvcc.cc:205] Tried to move back new op lower bound from 7317640855120826368 to 7317640854881746944. Current Snapshot: MvccSnapshot[applied={T|T < 7317640855120826368}]
I20260812 11:16:51.927172 18754 mvcc.cc:205] Tried to move back new op lower bound from 7317640855120826368 to 7317640854881746944. Current Snapshot: MvccSnapshot[applied={T|T < 7317640855120826368}]
I20260812 11:16:51.927796 18690 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.928256 18690 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:51.929924 18708 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.930524 18708 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 92499a9e08174780a5615e90182dbf57: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:51.932181 18692 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.932471 18692 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P 8c6d02634b1d4ca7ab791d190c6d8219: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.935539 18689 tablet_replica.cc:439] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92499a9e08174780a5615e90182dbf57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 } } peers { permanent_uuid: "92499a9e08174780a5615e90182dbf57" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 40799 } } peers { permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 } } }
I20260812 11:16:51.935818 18689 tablet_replica.cc:442] T e75d293c48804d20acbecbc68e39d794 P e8963d419dce49ce8776c8d9b57a1224: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:51.944103 18708 consensus_queue.cc:1035] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8963d419dce49ce8776c8d9b57a1224" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 45825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.952807 18690 consensus_queue.cc:1035] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6d02634b1d4ca7ab791d190c6d8219" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:51.965448 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.953794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:56281 (local address 127.15.164.194:40799)
0812 11:16:51.954028 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:51.954045 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:51.958241 (+ 4196us) server_negotiation.cc:407] Connection header received
0812 11:16:51.958580 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:51.958591 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:51.958691 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:51.958767 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:51.959898 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.961118 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.963052 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.963784 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.963918 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.964489 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:51.964651 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:51.964751 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:51.964946 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 11:16:51.965070 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":110}
I20260812 11:16:51.965509 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:51.952429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:40799 (local address 127.15.164.194:56281)
0812 11:16:51.958134 (+ 5705us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:51.958159 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:51.958382 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:51.958896 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:51.958900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:51.958913 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:51.959452 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.959672 (+ 220us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.961294 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.961299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.962872 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:51.962888 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:51.964006 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:51.964011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:51.964225 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:51.964294 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:51.964794 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:51.964807 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 11:16:51.964902 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:16:51.965120 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5439,"mutex_wait_us":46,"thread_start_us":5600,"threads_started":1}
I20260812 11:16:52.042721 17866 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:52.043260 17866 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36862:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:52.047189 17866 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6eaa6292161480191f7f369ea8db33f: Sending DeleteTablet for 3 replicas of tablet 628e6a68bb284f36a8a645d858d0af00
I20260812 11:16:52.048316 18304 tablet_service.cc:1514] Processing DeleteTablet for tablet 628e6a68bb284f36a8a645d858d0af00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:52 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:32966
I20260812 11:16:52.048394 18087 tablet_service.cc:1514] Processing DeleteTablet for tablet 628e6a68bb284f36a8a645d858d0af00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:52 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58070
I20260812 11:16:52.048475 18533 tablet_service.cc:1514] Processing DeleteTablet for tablet 628e6a68bb284f36a8a645d858d0af00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:52 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260812 11:16:52.058928 18778 tablet_replica.cc:330] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: stopping tablet replica
I20260812 11:16:52.059232 18778 raft_consensus.cc:2229] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:52.059528 18778 raft_consensus.cc:2258] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:52.060941 18776 tablet_replica.cc:330] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: stopping tablet replica
I20260812 11:16:52.061885 18776 raft_consensus.cc:2229] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:52.062321 18776 raft_consensus.cc:2258] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:52.063771 18778 ts_tablet_manager.cc:1905] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:52.063823 18776 ts_tablet_manager.cc:1905] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:52.067868 18777 tablet_replica.cc:330] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: stopping tablet replica
I20260812 11:16:52.068162 18777 raft_consensus.cc:2229] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:16:52.068739 18777 raft_consensus.cc:2258] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:52.070513 18777 ts_tablet_manager.cc:1905] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:52.073163 18776 ts_tablet_manager.cc:1918] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:52.073323 18776 log.cc:1196] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/628e6a68bb284f36a8a645d858d0af00
I20260812 11:16:52.073834 18776 ts_tablet_manager.cc:1939] T 628e6a68bb284f36a8a645d858d0af00 P 8c6d02634b1d4ca7ab791d190c6d8219: Deleting consensus metadata
I20260812 11:16:52.075137 17848 catalog_manager.cc:4841] TS 8c6d02634b1d4ca7ab791d190c6d8219 (127.15.164.193:43605): tablet 628e6a68bb284f36a8a645d858d0af00 (table test-table [id=dde0180ade2b43568a95fe8656ae4fed]) successfully deleted
I20260812 11:16:52.078943 18777 ts_tablet_manager.cc:1918] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:52.079110 18777 log.cc:1196] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/628e6a68bb284f36a8a645d858d0af00
I20260812 11:16:52.079660 18777 ts_tablet_manager.cc:1939] T 628e6a68bb284f36a8a645d858d0af00 P 92499a9e08174780a5615e90182dbf57: Deleting consensus metadata
I20260812 11:16:52.080850 17845 catalog_manager.cc:4841] TS 92499a9e08174780a5615e90182dbf57 (127.15.164.194:40799): tablet 628e6a68bb284f36a8a645d858d0af00 (table test-table [id=dde0180ade2b43568a95fe8656ae4fed]) successfully deleted
I20260812 11:16:52.081609 18778 ts_tablet_manager.cc:1918] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:52.081787 18778 log.cc:1196] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/628e6a68bb284f36a8a645d858d0af00
I20260812 11:16:52.082396 18778 ts_tablet_manager.cc:1939] T 628e6a68bb284f36a8a645d858d0af00 P e8963d419dce49ce8776c8d9b57a1224: Deleting consensus metadata
I20260812 11:16:52.083889 17851 catalog_manager.cc:4841] TS e8963d419dce49ce8776c8d9b57a1224 (127.15.164.195:45825): tablet 628e6a68bb284f36a8a645d858d0af00 (table test-table [id=dde0180ade2b43568a95fe8656ae4fed]) successfully deleted
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:16:52.094386 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:52.061377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.15.164.193:43605)
0812 11:16:52.069462 (+ 8085us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:52.069471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:52.074571 (+ 5100us) server_negotiation.cc:407] Connection header received
0812 11:16:52.074679 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:52.074689 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:52.074793 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:52.074927 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:52.078015 (+ 3088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.079245 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.081238 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.081977 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.082254 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:52.088085 (+ 5831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:52.088103 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:52.088120 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:52.088165 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:52.091427 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.092190 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.092198 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.092201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.092338 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.092737 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.092743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.092748 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.093143 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:52.093463 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:52.093793 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 11:16:52.094030 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7913,"thread_start_us":7786,"threads_started":1}
W20260812 11:16:52.095391 18188 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58078
I20260812 11:16:52.117198 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:52.099490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36882 (local address 127.15.164.254:39141)
0812 11:16:52.099747 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:52.099754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:52.099947 (+ 193us) server_negotiation.cc:407] Connection header received
0812 11:16:52.100144 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:52.100148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:52.100213 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:52.100301 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:52.102409 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.103492 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.105639 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.106069 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.106180 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:52.110595 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:52.110602 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:52.110606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:52.110646 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:52.113888 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.114922 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.114929 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.114932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.115100 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.115564 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.115568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.115570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.115920 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:52.116178 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:52.116661 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 11:16:52.116850 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:16:52.117951 17866 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36882
I20260812 11:16:52.120383 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17988
I20260812 11:16:52.137598 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:52.122077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.15.164.193:43605)
0812 11:16:52.122309 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:52.122313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:52.122329 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:16:52.122379 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:52.122382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:52.122457 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:52.122613 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:52.123720 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.124419 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.125609 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.126053 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.126192 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:52.129321 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:52.129330 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:52.129337 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:52.129398 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:52.133851 (+ 4453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.134911 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.134918 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.134923 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.135100 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.135602 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.135608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.135612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.136001 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:52.136300 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:52.136960 (+ 660us) server_negotiation.cc:299] Negotiation successful
0812 11:16:52.137226 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:16:52.138270 18188 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094
W20260812 11:16:52.139031 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17988: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:52.139235 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17988
I20260812 11:16:52.181977 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18200
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:16:52.201830 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:52.183063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32998 (local address 127.15.164.194:40799)
0812 11:16:52.183275 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:52.183280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:52.183301 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:16:52.183499 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:52.183503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:52.183568 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:52.183657 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:52.185296 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.186110 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.188122 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.188741 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.188876 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:52.194307 (+ 5431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:52.194324 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:52.194344 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:52.194400 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:52.198194 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.199216 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.199226 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.199229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.199402 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.199929 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.199934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.199937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.200412 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:52.200837 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:52.201101 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 11:16:52.201429 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:16:52.202793 18413 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32998
W20260812 11:16:52.203570 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18200: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:52.203768 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18200
I20260812 11:16:52.241763 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18431
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[17799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:16:52.259225 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:52.242795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33506 (local address 127.15.164.195:45825)
0812 11:16:52.243341 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:52.243346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:52.243363 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:16:52.243420 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:52.243424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:52.243492 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:52.243593 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:52.244990 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.245723 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.247042 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:52.247515 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:52.247629 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:52.252134 (+ 4505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:52.252150 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:52.252169 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:52.252214 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:52.255638 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.256562 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.256570 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.256573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.256716 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:52.257168 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:52.257172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:52.257174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:52.257619 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:52.257858 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:52.258717 (+ 859us) server_negotiation.cc:299] Negotiation successful
0812 11:16:52.258936 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":335,"threads_started":1}
W20260812 11:16:52.259967 18633 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33506
W20260812 11:16:52.260692 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18431: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:52.260849 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18431
I20260812 11:16:52.290144 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17820
I20260812 11:16:52.291682 17934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:52.411346 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17820
2026-08-12T11:16:52Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5528 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[18792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[18792](info): set up 2 sockets
Aug 12 11:16:52 dist-test-slave-7kzw krb5kdc[18792](info): commencing operation
krb5kdc: starting...
W20260812 11:16:53.766345 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:16:53 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:16:54.015728 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44251
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:54.374753 18810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:54.375092 18810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:54.375186 18810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:54.382745 18810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:54.382890 18810 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:16:54.382936 18810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:54.383038 18810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:54.383127 18810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:54.383225 18810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:54.394495 18810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44251
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:54.396241 18810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:54.397794 18810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:54.411214 18827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:54.411329 18825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:54.411923 18819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:54.412539 18810 server_base.cc:1034] running on GCE node
I20260812 11:16:54.413590 18810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:54.415319 18810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:54.416638 18810 hybrid_clock.cc:648] HybridClock initialized: now 1786533414416536 us; error 64 us; skew 500 ppm
I20260812 11:16:54.417140 18810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:54 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533414, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:54.422362 18810 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:16:54.424149 18810 webserver.cc:460] Webserver started at http://127.15.164.254:39345/ using document root <none> and password file <none>
I20260812 11:16:54.424958 18810 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:54.425056 18810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:54.425401 18810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:54.428671 18810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "75d90c2e93e04c29a43b3bd030d88e5a"
format_stamp: "Formatted at 2026-08-12 11:16:54 on dist-test-slave-7kzw"
server_key: "d89bafaca5ddc5b684e7e4c842fc8dd9"
server_key_iv: "c09319ce99d33bc7982b3d09c51147cd"
server_key_version: "encryptionkey@0"
I20260812 11:16:54.429495 18810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "75d90c2e93e04c29a43b3bd030d88e5a"
format_stamp: "Formatted at 2026-08-12 11:16:54 on dist-test-slave-7kzw"
server_key: "d89bafaca5ddc5b684e7e4c842fc8dd9"
server_key_iv: "c09319ce99d33bc7982b3d09c51147cd"
server_key_version: "encryptionkey@0"
I20260812 11:16:54.435317 18810 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:16:54.439337 18836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:54.441102 18810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:54.441320 18810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "75d90c2e93e04c29a43b3bd030d88e5a"
format_stamp: "Formatted at 2026-08-12 11:16:54 on dist-test-slave-7kzw"
server_key: "d89bafaca5ddc5b684e7e4c842fc8dd9"
server_key_iv: "c09319ce99d33bc7982b3d09c51147cd"
server_key_version: "encryptionkey@0"
I20260812 11:16:54.441563 18810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:54.464283 18810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:54.469802 18810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:54.470113 18810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:54.518155 18810 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44251
I20260812 11:16:54.518198 18951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44251 every 8 connection(s)
I20260812 11:16:54.520237 18810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:54.523108 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18810
I20260812 11:16:54.523396 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:16:54.524286 16019 external_mini_cluster.cc:1428] Setting key f2b185868ff7ef9caecdcee268d6a7f3
I20260812 11:16:54.530392 18952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:16:54 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:54.545886 18952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Bootstrap starting.
I20260812 11:16:54.550540 18952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:54.552212 18952 log.cc:824] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:54.555558 18952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: No bootstrap required, opened a new log
I20260812 11:16:54.556756 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:54.527887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57922 (local address 127.15.164.254:44251)
0812 11:16:54.528854 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:54.528870 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:54.528923 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:16:54.531459 (+ 2536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:54.531491 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:54.532033 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:54.532502 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:54.534835 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:54.536978 (+ 2143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:54.539466 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:54.540559 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:54.540773 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:54.547040 (+ 6267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:54.547051 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:54.547070 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:54.547125 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:54.551698 (+ 4573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:54.552939 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:54.552955 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:54.552964 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:54.553190 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:54.553662 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:54.553668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:54.553671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:54.554287 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:54.554635 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:54.555114 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 11:16:54.555637 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":415,"threads_started":1}
I20260812 11:16:54.564251 18952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } }
I20260812 11:16:54.564791 18952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:54.564949 18952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75d90c2e93e04c29a43b3bd030d88e5a, State: Initialized, Role: FOLLOWER
I20260812 11:16:54.565682 18952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } }
I20260812 11:16:54.565945 18952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:54.566085 18952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:54.566304 18952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:54.568611 18952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } }
I20260812 11:16:54.569149 18952 leader_election.cc:302] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75d90c2e93e04c29a43b3bd030d88e5a; no voters:
I20260812 11:16:54.569805 18952 leader_election.cc:288] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:54.570030 18966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:54.570864 18966 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [term 1 LEADER]: Becoming Leader. State: Replica: 75d90c2e93e04c29a43b3bd030d88e5a, State: Running, Role: LEADER
I20260812 11:16:54.571414 18966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } }
I20260812 11:16:54.572382 18952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:54.574885 18967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } } }
I20260812 11:16:54.574910 18970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75d90c2e93e04c29a43b3bd030d88e5a. Latest consensus state: current_term: 1 leader_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d90c2e93e04c29a43b3bd030d88e5a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44251 } } }
I20260812 11:16:54.575531 18967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:54.575644 18970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:54.577595 18975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:54.584165 18975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:54.595577 18975 catalog_manager.cc:1347] Generated new cluster ID: f49bb6401a194634b687ecf8a6616482
I20260812 11:16:54.595714 18975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:54.628438 18975 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:54.630494 18975 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:54.647924 18975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Generated new TSK 0
I20260812 11:16:54.649142 18975 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:16:54.712301 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44251
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:55.059479 18998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:55.059787 18998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:55.059967 18998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:55.067260 18998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:55.067378 18998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:55.067554 18998 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:16:55.067637 18998 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:55.067759 18998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:16:55.077811 18998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:55.079162 18998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:55.080556 18998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:55.094216 19006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:55.094184 19009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:55.094153 19007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:55.095638 18998 server_base.cc:1034] running on GCE node
I20260812 11:16:55.096330 18998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:55.097326 18998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:55.098562 18998 hybrid_clock.cc:648] HybridClock initialized: now 1786533415098507 us; error 48 us; skew 500 ppm
I20260812 11:16:55.098891 18998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:55 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533415, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:55.102169 18998 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:16:55.103667 18998 webserver.cc:460] Webserver started at http://127.15.164.193:44863/ using document root <none> and password file <none>
I20260812 11:16:55.104439 18998 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:55.104543 18998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:55.104811 18998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:55.107720 18998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "92aedd21dece22a66fa62554ae46abad"
server_key_iv: "e44f223707c5e2c0517a879bec134192"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.108455 18998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "92aedd21dece22a66fa62554ae46abad"
server_key_iv: "e44f223707c5e2c0517a879bec134192"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.113590 18998 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260812 11:16:55.117395 19019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:55.119335 18998 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:16:55.119520 18998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "92aedd21dece22a66fa62554ae46abad"
server_key_iv: "e44f223707c5e2c0517a879bec134192"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.119772 18998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:55.151710 18998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:55.156565 18998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:55.156951 18998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:55.160111 18998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:55.160262 18998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:55.160416 18998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:55.160522 18998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:55 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533415, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:55.191905 19036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.160945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:36281 (local address 127.15.164.254:44251)
0812 11:16:55.161603 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:55.161610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:55.162862 (+ 1252us) server_negotiation.cc:407] Connection header received
0812 11:16:55.165266 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:55.165273 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:55.165393 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:55.165567 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:55.169320 (+ 3753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.170337 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.174056 (+ 3719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.174914 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.175093 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.181681 (+ 6588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:55.181692 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:55.181697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:55.181756 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:55.186573 (+ 4817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.188049 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.188057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.188061 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.188266 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.189003 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.189009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.189012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.189493 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:55.189673 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:55.191087 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0812 11:16:55.191399 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":394,"threads_started":1}
I20260812 11:16:55.193624 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.161713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.193:36281)
0812 11:16:55.162663 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:55.162724 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:55.164876 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:55.166164 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:55.166185 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:55.167521 (+ 1336us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:55.168910 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.168950 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.170625 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.170634 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.173848 (+ 3214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.173867 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.175234 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.175246 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.175697 (+ 451us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.176821 (+ 1124us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:55.176871 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:55.181312 (+ 4441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:55.186842 (+ 5530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.186859 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.186891 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.187857 (+ 966us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.188433 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.188448 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.188456 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.188826 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.189684 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:55.189700 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:55.190414 (+ 714us) client_negotiation.cc:769] Sending connection context
0812 11:16:55.190901 (+ 487us) client_negotiation.cc:240] Negotiation successful
0812 11:16:55.191699 (+ 798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":395,"threads_started":1}
I20260812 11:16:55.205011 18998 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:45637
I20260812 11:16:55.205020 19203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:45637 every 8 connection(s)
I20260812 11:16:55.206823 18998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:16:55.209678 19204 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44251
I20260812 11:16:55.209967 19204 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:55.210928 19204 heartbeater.cc:511] Master 127.15.164.254:44251 requested a full tablet report, sending...
I20260812 11:16:55.213572 18874 ts_manager.cc:194] Registered new tserver with Master: 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637)
I20260812 11:16:55.215804 18874 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:36281
I20260812 11:16:55.216413 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18998
I20260812 11:16:55.216632 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:16:55.217458 16019 external_mini_cluster.cc:1428] Setting key b884f70bf4e4088c458c0f7e846c8187
I20260812 11:16:55.219095 19197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.202832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.193:57451)
0812 11:16:55.203486 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:55.203504 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:55.203757 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:55.204462 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:55.204468 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:55.205260 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:55.205686 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.205734 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.206898 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.206907 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.208566 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.208599 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.209654 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.209667 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.209864 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.210567 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:55.210599 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:55.211703 (+ 1104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:55.215670 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.215675 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.215678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.216273 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.216954 (+ 681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.216958 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.216961 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.217101 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.217883 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:55.217888 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:55.218113 (+ 225us) client_negotiation.cc:769] Sending connection context
0812 11:16:55.218290 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 11:16:55.218631 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":398,"threads_started":1}
I20260812 11:16:55.219983 19036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.201955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:57451 (local address 127.15.164.254:44251)
0812 11:16:55.202126 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:55.202131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:55.203613 (+ 1482us) server_negotiation.cc:407] Connection header received
0812 11:16:55.203947 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:55.203957 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:55.204080 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:55.204204 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:55.205894 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.206714 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.208751 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.209387 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.209501 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.211939 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:55.211948 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:55.211953 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:55.211996 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:55.215512 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.216417 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.216427 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.216432 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.216647 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.217235 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.217243 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.217249 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.217731 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:55.217917 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:55.219420 (+ 1503us) server_negotiation.cc:299] Negotiation successful
0812 11:16:55.219660 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:16:55.266165 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44251
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:55.627609 19212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:55.627933 19212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:55.628089 19212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:55.635505 19212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:55.635629 19212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:55.635785 19212 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:16:55.635847 19212 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:55.635958 19212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:16:55.646135 19212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:55.648022 19212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:55.649575 19212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:55.665881 19221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:55.665926 19224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:55.666922 19228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:55.669064 19212 server_base.cc:1034] running on GCE node
I20260812 11:16:55.670258 19212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:55.671700 19212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:55.672997 19212 hybrid_clock.cc:648] HybridClock initialized: now 1786533415672884 us; error 68 us; skew 500 ppm
I20260812 11:16:55.673379 19212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:55 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533415, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:55.677184 19212 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:16:55.678998 19212 webserver.cc:460] Webserver started at http://127.15.164.194:40461/ using document root <none> and password file <none>
I20260812 11:16:55.679812 19212 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:55.679970 19212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:55.680330 19212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:55.683714 19212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "1d6f895b9c1ec0b90f94bc3d4590c53f"
server_key_iv: "f4d187908e8b8064ea31e439e5d15166"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.684587 19212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "1d6f895b9c1ec0b90f94bc3d4590c53f"
server_key_iv: "f4d187908e8b8064ea31e439e5d15166"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.690778 19212 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 11:16:55.695084 19242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:55.697188 19212 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:16:55.697530 19212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
format_stamp: "Formatted at 2026-08-12 11:16:55 on dist-test-slave-7kzw"
server_key: "1d6f895b9c1ec0b90f94bc3d4590c53f"
server_key_iv: "f4d187908e8b8064ea31e439e5d15166"
server_key_version: "encryptionkey@0"
I20260812 11:16:55.697870 19212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:55.719837 19212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:55.725538 19212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:55.725911 19212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:55.729103 19212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:55.729269 19212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:55.729413 19212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:55.729511 19212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:55 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533415, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:55.759796 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.729903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:58809 (local address 127.15.164.254:44251)
0812 11:16:55.730580 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:55.730587 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:55.732016 (+ 1429us) server_negotiation.cc:407] Connection header received
0812 11:16:55.735582 (+ 3566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:55.735590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:55.735695 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:55.735826 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:55.738639 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.740115 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.743447 (+ 3332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.744282 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.744473 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.751242 (+ 6769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:55.751251 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:55.751258 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:55.751316 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:55.754840 (+ 3524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.756093 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.756102 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.756108 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.756336 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.757225 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.757235 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.757253 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.757721 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:55.757929 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:55.759043 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0812 11:16:55.759356 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":382,"threads_started":1}
I20260812 11:16:55.761313 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.730783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.194:58809)
0812 11:16:55.731790 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:55.731849 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:55.735086 (+ 3237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:55.736196 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:55.736213 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:55.737275 (+ 1062us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:55.738318 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.738352 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.740322 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.740326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.743091 (+ 2765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.743136 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.744675 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.744690 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.745057 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.746244 (+ 1187us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:55.746328 (+ 84us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:55.750849 (+ 4521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:55.755074 (+ 4225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.755086 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.755112 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.755895 (+ 783us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.756515 (+ 620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.756527 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.756534 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.757049 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.757898 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:55.757909 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:55.758411 (+ 502us) client_negotiation.cc:769] Sending connection context
0812 11:16:55.758923 (+ 512us) client_negotiation.cc:240] Negotiation successful
0812 11:16:55.759641 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":399,"threads_started":1}
I20260812 11:16:55.790350 19212 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:37443
I20260812 11:16:55.790377 19440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:37443 every 8 connection(s)
I20260812 11:16:55.792091 19212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:16:55.793951 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.774009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:51891 (local address 127.15.164.254:44251)
0812 11:16:55.774357 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:55.774366 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:55.776075 (+ 1709us) server_negotiation.cc:407] Connection header received
0812 11:16:55.776233 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:55.776294 (+ 61us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:55.776500 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:55.776732 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:55.778385 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.779805 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.781371 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.782176 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.782355 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.785764 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:55.785775 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:55.785783 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:55.785842 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:55.790146 (+ 4304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.791134 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.791140 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.791144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.791315 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:55.791767 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:55.791772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:55.791775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:55.792305 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:55.792472 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:55.793020 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 11:16:55.793354 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 11:16:55.793973 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:55.774584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.194:51891)
0812 11:16:55.775899 (+ 1315us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:55.775932 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:55.776107 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:55.776794 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:55.776802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:55.777764 (+ 962us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:55.778169 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.778183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.780026 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.780035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.781197 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:55.781212 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:55.782447 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:55.782457 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:55.782808 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:55.783804 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:55.783842 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:55.785486 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:55.790370 (+ 4884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.790377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.790383 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.790984 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.791463 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:55.791467 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:55.791470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:55.791623 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:55.792442 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:55.792450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:55.792634 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 11:16:55.792840 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 11:16:55.793244 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1129,"thread_start_us":916,"threads_started":1}
I20260812 11:16:55.794945 19442 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44251
I20260812 11:16:55.795228 19442 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:55.796157 19442 heartbeater.cc:511] Master 127.15.164.254:44251 requested a full tablet report, sending...
I20260812 11:16:55.798065 18873 ts_manager.cc:194] Registered new tserver with Master: c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443)
I20260812 11:16:55.799314 18873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:58809
I20260812 11:16:55.800629 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19212
I20260812 11:16:55.800884 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:16:55.801672 16019 external_mini_cluster.cc:1428] Setting key 3745a371b634ea9325be96176fbaef15
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:16:55.864554 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44251
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:16:56.219986 19204 heartbeater.cc:503] Master 127.15.164.254:44251 was elected leader, sending a full tablet report...
W20260812 11:16:56.250360 19447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:56.250815 19447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:56.251004 19447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:56.258713 19447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:56.258882 19447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:56.259030 19447 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:16:56.259117 19447 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:16:56.259253 19447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:16:56.270834 19447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:56.272390 19447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:56.273936 19447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:56.290912 19456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:56.291038 19455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:56.290889 19459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:56.291553 19447 server_base.cc:1034] running on GCE node
I20260812 11:16:56.292299 19447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:56.293424 19447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:56.294780 19447 hybrid_clock.cc:648] HybridClock initialized: now 1786533416294603 us; error 67 us; skew 500 ppm
I20260812 11:16:56.295176 19447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:56 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533416, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:56.299894 19447 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:16:56.301623 19447 webserver.cc:460] Webserver started at http://127.15.164.195:36377/ using document root <none> and password file <none>
I20260812 11:16:56.302421 19447 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:56.302598 19447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:56.302950 19447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:56.306134 19447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "a1b75abcb32f4573892c61eacd1bef2d"
format_stamp: "Formatted at 2026-08-12 11:16:56 on dist-test-slave-7kzw"
server_key: "9899529b51a697f9b0fca438d9e5936d"
server_key_iv: "2e2ab3531957e0d7e30a7fe67f3ee48f"
server_key_version: "encryptionkey@0"
I20260812 11:16:56.307098 19447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "a1b75abcb32f4573892c61eacd1bef2d"
format_stamp: "Formatted at 2026-08-12 11:16:56 on dist-test-slave-7kzw"
server_key: "9899529b51a697f9b0fca438d9e5936d"
server_key_iv: "2e2ab3531957e0d7e30a7fe67f3ee48f"
server_key_version: "encryptionkey@0"
I20260812 11:16:56.313592 19447 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:16:56.319176 19469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:56.320865 19447 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:16:56.321074 19447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "a1b75abcb32f4573892c61eacd1bef2d"
format_stamp: "Formatted at 2026-08-12 11:16:56 on dist-test-slave-7kzw"
server_key: "9899529b51a697f9b0fca438d9e5936d"
server_key_iv: "2e2ab3531957e0d7e30a7fe67f3ee48f"
server_key_version: "encryptionkey@0"
I20260812 11:16:56.321329 19447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:56.342988 19447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:56.348275 19447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:56.348603 19447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:56.351663 19447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:16:56.351817 19447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:56.351954 19447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:16:56.352064 19447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:16:56 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533416, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:56.381922 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.352240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:39767 (local address 127.15.164.254:44251)
0812 11:16:56.353217 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.353225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.354514 (+ 1289us) server_negotiation.cc:407] Connection header received
0812 11:16:56.357748 (+ 3234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.357758 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.357894 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.358040 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:56.361435 (+ 3395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.363219 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.365591 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.366151 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.366304 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.372720 (+ 6416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:56.372726 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:56.372730 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:56.372770 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:56.377056 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.378556 (+ 1500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.378565 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.378570 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.378764 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.379281 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.379289 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.379295 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.379779 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:56.379990 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.380997 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.381337 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":823,"thread_start_us":677,"threads_started":1}
I20260812 11:16:56.382699 19483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.352917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.195:39767)
0812 11:16:56.354253 (+ 1336us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.354330 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.357249 (+ 2919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.358399 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.358410 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.359509 (+ 1099us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:56.361131 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.361169 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.363505 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.363511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.365382 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.365398 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.366838 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.366858 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.367496 (+ 638us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.368991 (+ 1495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:56.369035 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:56.372402 (+ 3367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:56.377320 (+ 4918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.377342 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.377377 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.378295 (+ 918us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.378912 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.378917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.378926 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.379136 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.380012 (+ 876us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:56.380023 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:56.380540 (+ 517us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.380810 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.381280 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"thread_start_us":385,"threads_started":1}
I20260812 11:16:56.405439 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.389035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.15.164.195:38409)
0812 11:16:56.389911 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.389928 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.390147 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.390588 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.390593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.391450 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:56.392016 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.392030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.393392 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.393397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.395170 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.395193 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.396517 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.396525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.396905 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.397805 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:56.397824 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:56.398683 (+ 859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:56.401939 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.401945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.401949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.402527 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.402991 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.402997 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.403001 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.403160 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.404032 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:56.404040 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:56.404392 (+ 352us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.404593 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.405011 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":449,"threads_started":1}
I20260812 11:16:56.405932 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.388979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:38409 (local address 127.15.164.254:44251)
0812 11:16:56.389153 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.389159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.390019 (+ 860us) server_negotiation.cc:407] Connection header received
0812 11:16:56.390307 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.390311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.390391 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.390524 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:56.392175 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.393181 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.395524 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.396131 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.396279 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.398924 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:56.398930 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:56.398933 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:56.398970 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:56.401781 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.402661 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.402668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.402672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.402856 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.403352 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.403361 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.403367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.403842 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:56.404361 (+ 519us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.404784 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.405132 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:16:56.421614 19447 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:36011
I20260812 11:16:56.421761 19663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:36011 every 8 connection(s)
I20260812 11:16:56.423051 19447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:16:56.425825 19664 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44251
I20260812 11:16:56.426170 19664 heartbeater.cc:464] Registering TS with master...
I20260812 11:16:56.427142 19664 heartbeater.cc:511] Master 127.15.164.254:44251 requested a full tablet report, sending...
I20260812 11:16:56.428719 18873 ts_manager.cc:194] Registered new tserver with Master: a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:56.429564 18873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:39767
I20260812 11:16:56.431368 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19447
I20260812 11:16:56.431555 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:16:56.432104 16019 external_mini_cluster.cc:1428] Setting key b2b378b17b8cbdd39ad68e12f3cfb947
I20260812 11:16:56.435881 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:16:56 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:16:56 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:56.493865 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.476293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57926 (local address 127.15.164.254:44251)
0812 11:16:56.476582 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.476587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.476954 (+ 367us) server_negotiation.cc:407] Connection header received
0812 11:16:56.477230 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.477236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.477409 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.477513 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:56.479242 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.480249 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.481776 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.482207 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.482326 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.487546 (+ 5220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:56.487553 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:56.487557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:56.487609 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:56.490790 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.491830 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.491837 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.491839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.492011 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.492416 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.492421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.492423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.492761 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:56.492997 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.493369 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.493561 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260812 11:16:56.499207 18873 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:56.506747 18873 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:56.557013 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.525902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55470 (local address 127.15.164.194:37443)
0812 11:16:56.541413 (+ 15511us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.541428 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.546868 (+ 5440us) server_negotiation.cc:407] Connection header received
0812 11:16:56.546989 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.546997 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.547453 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.547723 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:56.548936 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.550712 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.554030 (+ 3318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.555366 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.555547 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.555780 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.556514 (+ 734us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.556697 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15210,"thread_start_us":15530,"threads_started":1}
I20260812 11:16:56.557171 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.525606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.0.0.1:55470)
0812 11:16:56.546555 (+ 20949us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.546576 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.546720 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.548051 (+ 1331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.548060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.548097 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:56.548635 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.548679 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.550874 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.550880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.553749 (+ 2869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.553763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.555968 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.555975 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.556234 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.556281 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.556447 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.556679 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20761,"mutex_wait_us":32,"thread_start_us":19428,"threads_started":1}
I20260812 11:16:56.559198 19689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.522652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41552)
0812 11:16:56.545497 (+ 22845us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.545560 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.545811 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.551155 (+ 5344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.551160 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.551193 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:56.551719 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.551749 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.553919 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.553924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.556314 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.556329 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.558338 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.558348 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.558570 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.558614 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.558720 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.558865 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22536,"thread_start_us":24567,"threads_started":1}
I20260812 11:16:56.559297 19686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.522819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.15.164.193:45637)
0812 11:16:56.550388 (+ 27569us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.550397 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.550429 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:16:56.550563 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.550573 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.550896 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.551998 (+ 1102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:56.552261 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.553768 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.556526 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.558060 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.558272 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.558495 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.558788 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.558973 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27406,"thread_start_us":27258,"threads_started":1}
I20260812 11:16:56.561313 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.550287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36011 (local address 127.0.0.1:55748)
0812 11:16:56.552169 (+ 1882us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.552192 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.552327 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.552913 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.552918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.552947 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:56.553445 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.553455 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.555889 (+ 2434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.555895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.558262 (+ 2367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.558278 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.560447 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.560454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.560643 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.560676 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.560781 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.560922 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1739,"mutex_wait_us":5,"thread_start_us":1556,"threads_started":1}
I20260812 11:16:56.561359 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.548098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55748 (local address 127.15.164.195:36011)
0812 11:16:56.549868 (+ 1770us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.549883 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.552326 (+ 2443us) server_negotiation.cc:407] Connection header received
0812 11:16:56.552493 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.552501 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.552714 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.552924 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:56.553687 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.555676 (+ 1989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.558498 (+ 2822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.560204 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.560421 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.560617 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.560847 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.561016 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1514,"thread_start_us":1252,"threads_started":1}
I20260812 11:16:56.561800 19327 tablet_service.cc:1467] Processing CreateTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 (DEFAULT_TABLE table=test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:56.563408 19327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f8851140ab4fbaa359c205a53f4e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.563674 19100 tablet_service.cc:1467] Processing CreateTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 (DEFAULT_TABLE table=test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:56.565325 19100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f8851140ab4fbaa359c205a53f4e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.565744 19542 tablet_service.cc:1467] Processing CreateTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 (DEFAULT_TABLE table=test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:56.567417 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f8851140ab4fbaa359c205a53f4e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.578547 19693 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Bootstrap starting.
I20260812 11:16:56.581871 19693 tablet_bootstrap.cc:654] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.582866 19695 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Bootstrap starting.
I20260812 11:16:56.583423 19693 log.cc:824] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:56.588088 19695 tablet_bootstrap.cc:654] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.589664 19696 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Bootstrap starting.
I20260812 11:16:56.589938 19695 log.cc:824] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:56.594239 19696 tablet_bootstrap.cc:654] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.594556 19693 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: No bootstrap required, opened a new log
I20260812 11:16:56.594556 19695 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: No bootstrap required, opened a new log
I20260812 11:16:56.594882 19693 ts_tablet_manager.cc:1397] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.006s
I20260812 11:16:56.594882 19695 ts_tablet_manager.cc:1397] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260812 11:16:56.595630 19696 log.cc:824] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:56.599074 19696 tablet_bootstrap.cc:492] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: No bootstrap required, opened a new log
I20260812 11:16:56.599388 19696 ts_tablet_manager.cc:1397] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:16:56.606441 19695 raft_consensus.cc:348] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.606441 19693 raft_consensus.cc:348] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.607033 19695 raft_consensus.cc:374] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.607033 19693 raft_consensus.cc:374] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.607151 19693 raft_consensus.cc:729] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.607151 19695 raft_consensus.cc:729] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.607138 19696 raft_consensus.cc:348] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.607643 19696 raft_consensus.cc:374] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.607762 19696 raft_consensus.cc:729] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.608094 19693 consensus_queue.cc:260] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.608078 19695 consensus_queue.cc:260] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.608424 19696 consensus_queue.cc:260] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.609603 19442 heartbeater.cc:503] Master 127.15.164.254:44251 was elected leader, sending a full tablet report...
I20260812 11:16:56.611214 19693 ts_tablet_manager.cc:1428] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent starting tablet: real 0.016s user 0.010s sys 0.005s
I20260812 11:16:56.617933 19664 heartbeater.cc:503] Master 127.15.164.254:44251 was elected leader, sending a full tablet report...
I20260812 11:16:56.618258 19695 ts_tablet_manager.cc:1428] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent starting tablet: real 0.023s user 0.018s sys 0.004s
I20260812 11:16:56.618654 19696 ts_tablet_manager.cc:1428] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Time spent starting tablet: real 0.019s user 0.020s sys 0.000s
I20260812 11:16:56.628893 19705 raft_consensus.cc:482] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:56.629238 19705 raft_consensus.cc:504] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.631982 19705 leader_election.cc:288] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443)
I20260812 11:16:56.637969 19483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.631510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.15.164.195:58901)
0812 11:16:56.631979 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.632003 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.632258 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.632928 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.632936 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.632974 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:56.633229 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.633244 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.634361 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.634367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.635876 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.635890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.637112 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.637119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.637353 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.637380 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.637497 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.637663 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294}
I20260812 11:16:56.637965 19686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.631618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:58901 (local address 127.15.164.193:45637)
0812 11:16:56.631982 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.631991 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.632535 (+ 544us) server_negotiation.cc:407] Connection header received
0812 11:16:56.632666 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.632671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.632766 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.632869 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:56.633400 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.634200 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.636061 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.636935 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.637128 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.637215 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.637529 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.637690 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:16:56.638373 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.632253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:48469 (local address 127.15.164.194:37443)
0812 11:16:56.632491 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.632497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.632983 (+ 486us) server_negotiation.cc:407] Connection header received
0812 11:16:56.633319 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.633325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.633404 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.633511 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:56.634045 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.634825 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.636589 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.637397 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.637595 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.637675 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.637972 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.638111 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 11:16:56.639173 19706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.631679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.15.164.195:48469)
0812 11:16:56.632879 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.632898 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.633089 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.633536 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.633540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.633574 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:56.633879 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.633888 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.634961 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.634967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.636408 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.636423 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.637623 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.637630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.637810 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.637838 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.637944 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.638076 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1037,"mutex_wait_us":1,"thread_start_us":838,"threads_started":1}
I20260812 11:16:56.639078 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f8851140ab4fbaa359c205a53f4e42" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" is_pre_election: true
I20260812 11:16:56.639631 19132 raft_consensus.cc:2454] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 0.
I20260812 11:16:56.640386 19471 leader_election.cc:302] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, a1b75abcb32f4573892c61eacd1bef2d; no voters:
I20260812 11:16:56.640283 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f8851140ab4fbaa359c205a53f4e42" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" is_pre_election: true
I20260812 11:16:56.640880 19705 raft_consensus.cc:2781] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:56.640889 19361 raft_consensus.cc:2454] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 0.
I20260812 11:16:56.641048 19705 raft_consensus.cc:482] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:56.641158 19705 raft_consensus.cc:3037] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:56.643625 19705 raft_consensus.cc:504] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.644269 19705 leader_election.cc:288] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 election: Requested vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443)
I20260812 11:16:56.644819 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f8851140ab4fbaa359c205a53f4e42" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
I20260812 11:16:56.644999 19361 raft_consensus.cc:3037] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:56.644845 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f8851140ab4fbaa359c205a53f4e42" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
I20260812 11:16:56.645268 19132 raft_consensus.cc:3037] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:56.647610 19361 raft_consensus.cc:2454] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 1.
I20260812 11:16:56.647751 19132 raft_consensus.cc:2454] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 1.
I20260812 11:16:56.648219 19475 leader_election.cc:302] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, a1b75abcb32f4573892c61eacd1bef2d, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:56.648584 19705 raft_consensus.cc:2781] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:56.649037 19705 raft_consensus.cc:686] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 1 LEADER]: Becoming Leader. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Running, Role: LEADER
I20260812 11:16:56.649551 19705 consensus_queue.cc:237] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } }
I20260812 11:16:56.655146 18872 catalog_manager.cc:5495] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195). New cstate: current_term: 1 leader_uuid: "a1b75abcb32f4573892c61eacd1bef2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } health_report { overall_health: UNKNOWN } } }
W20260812 11:16:56.675091 19665 tablet.cc:2369] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:16:56.710214 19205 tablet.cc:2369] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:16:56 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533414, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:56.737099 19724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.721289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44251 (local address 127.0.0.1:57936)
0812 11:16:56.722024 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:56.722043 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:56.722265 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:56.722671 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:56.722675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:56.723615 (+ 940us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:56.723921 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.723932 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.724990 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.724998 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.726055 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:56.726068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.726936 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.726941 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:56.727105 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.727912 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:56.727930 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:56.730411 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:56.734045 (+ 3634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.734060 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.734068 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.734766 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.735332 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:56.735336 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:56.735340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:56.735512 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:56.736149 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:56.736156 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:56.736374 (+ 218us) client_negotiation.cc:769] Sending connection context
0812 11:16:56.736536 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 11:16:56.736769 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":424,"threads_started":1}
I20260812 11:16:56.737200 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:56.721275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57936 (local address 127.15.164.254:44251)
0812 11:16:56.721513 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:56.721519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:56.722150 (+ 631us) server_negotiation.cc:407] Connection header received
0812 11:16:56.722416 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:56.722420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:56.722543 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:56.722644 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:56.724083 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.724858 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.726195 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:56.726743 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:56.726886 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:56.730682 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:56.730688 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:56.730691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:56.730733 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:56.733722 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.734922 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.734927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.734930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.735157 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:56.735670 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:56.735674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:56.735676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:56.735976 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:56.736123 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:56.736725 (+ 602us) server_negotiation.cc:299] Negotiation successful
0812 11:16:56.736920 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:16:56.742925 18872 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57936:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:16:56.744091 18872 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:56.751828 19100 tablet_service.cc:1467] Processing CreateTablet for tablet 75519d2c12fc4b99aa29ec519a38a531 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2371e6efb1824d34a28b1f6d1648b550]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:56.752027 19327 tablet_service.cc:1467] Processing CreateTablet for tablet 75519d2c12fc4b99aa29ec519a38a531 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2371e6efb1824d34a28b1f6d1648b550]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:56.752134 19542 tablet_service.cc:1467] Processing CreateTablet for tablet 75519d2c12fc4b99aa29ec519a38a531 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2371e6efb1824d34a28b1f6d1648b550]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:16:56.752903 19100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75519d2c12fc4b99aa29ec519a38a531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.752997 19327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75519d2c12fc4b99aa29ec519a38a531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.752997 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75519d2c12fc4b99aa29ec519a38a531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:56.759511 19695 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: Bootstrap starting.
I20260812 11:16:56.760604 19696 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: Bootstrap starting.
I20260812 11:16:56.761106 19693 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: Bootstrap starting.
I20260812 11:16:56.761266 19695 tablet_bootstrap.cc:654] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.762450 19696 tablet_bootstrap.cc:654] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.762638 19693 tablet_bootstrap.cc:654] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:56.764164 19695 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: No bootstrap required, opened a new log
I20260812 11:16:56.764390 19695 ts_tablet_manager.cc:1397] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:16:56.765370 19695 raft_consensus.cc:348] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.765645 19695 raft_consensus.cc:374] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.765712 19696 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: No bootstrap required, opened a new log
I20260812 11:16:56.765765 19695 raft_consensus.cc:729] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.765822 19693 tablet_bootstrap.cc:492] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: No bootstrap required, opened a new log
I20260812 11:16:56.765961 19693 ts_tablet_manager.cc:1397] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 11:16:56.765878 19696 ts_tablet_manager.cc:1397] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:16:56.766042 19695 consensus_queue.cc:260] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.766685 19695 ts_tablet_manager.cc:1428] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:16:56.766853 19693 raft_consensus.cc:348] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.766848 19696 raft_consensus.cc:348] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.767115 19696 raft_consensus.cc:374] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.767113 19693 raft_consensus.cc:374] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:56.767222 19696 raft_consensus.cc:729] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.767221 19693 raft_consensus.cc:729] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Initialized, Role: FOLLOWER
I20260812 11:16:56.767477 19693 consensus_queue.cc:260] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.767509 19696 consensus_queue.cc:260] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:56.767940 19705 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:56.768133 19693 ts_tablet_manager.cc:1428] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:16:56.767978 19703 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:56.768263 19705 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:56.768364 19703 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:56.768496 19704 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:56.768841 19704 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:56.769644 19696 ts_tablet_manager.cc:1428] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260812 11:16:56.799235 19443 tablet.cc:2369] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:56.998347 19703 raft_consensus.cc:482] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:56.998656 19703 raft_consensus.cc:504] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.000378 19703 leader_election.cc:288] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:57.007947 19686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.001081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:50359 (local address 127.15.164.193:45637)
0812 11:16:57.001316 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.001321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.001601 (+ 280us) server_negotiation.cc:407] Connection header received
0812 11:16:57.001873 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.001878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.001987 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.002055 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:57.003120 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.004005 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.005967 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.006867 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.007080 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.007166 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.007475 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.007613 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:16:57.007992 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.000787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.15.164.194:50359)
0812 11:16:57.001464 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.001486 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.001644 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.002296 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.002299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.002324 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:57.002883 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.002895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.004151 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.004158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.005767 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.005792 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.007105 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.007113 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.007298 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.007325 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.007443 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.007607 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":340,"threads_started":1}
I20260812 11:16:57.008271 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.001860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:51187 (local address 127.15.164.195:36011)
0812 11:16:57.002088 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.002094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.002729 (+ 635us) server_negotiation.cc:407] Connection header received
0812 11:16:57.002949 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.002954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.003023 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.003154 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:57.003738 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.004482 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.006418 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.007289 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.007485 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.007607 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.007879 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.008012 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 11:16:57.008343 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.001590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36011 (local address 127.15.164.194:51187)
0812 11:16:57.002616 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.002635 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.002803 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.003172 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.003176 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.003203 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:57.003535 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.003566 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.004805 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.004813 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.006245 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.006260 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.007529 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.007535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.007713 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.007739 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.007850 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.007988 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":365,"threads_started":1}
I20260812 11:16:57.009073 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75519d2c12fc4b99aa29ec519a38a531" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" is_pre_election: true
I20260812 11:16:57.009351 19132 raft_consensus.cc:2454] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 0.
I20260812 11:16:57.009488 19583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75519d2c12fc4b99aa29ec519a38a531" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d" is_pre_election: true
I20260812 11:16:57.009859 19583 raft_consensus.cc:2454] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 0.
I20260812 11:16:57.009867 19246 leader_election.cc:302] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:57.010304 19703 raft_consensus.cc:2781] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:57.010457 19703 raft_consensus.cc:482] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:57.010593 19703 raft_consensus.cc:3037] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.013062 19703 raft_consensus.cc:504] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.013893 19703 leader_election.cc:288] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 election: Requested vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:57.014300 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75519d2c12fc4b99aa29ec519a38a531" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
I20260812 11:16:57.014572 19132 raft_consensus.cc:3037] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.014760 19583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75519d2c12fc4b99aa29ec519a38a531" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d"
I20260812 11:16:57.015038 19583 raft_consensus.cc:3037] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.016867 19132 raft_consensus.cc:2454] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 1.
I20260812 11:16:57.017439 19583 raft_consensus.cc:2454] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 1.
I20260812 11:16:57.017666 19246 leader_election.cc:302] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:57.018047 19703 raft_consensus.cc:2781] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:57.018607 19703 raft_consensus.cc:686] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 LEADER]: Becoming Leader. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Running, Role: LEADER
I20260812 11:16:57.019218 19703 consensus_queue.cc:237] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.022938 19736 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: TxnStatusTablet state changed. Reason: New leader c54f23e963b34dc1a0ec7b3cba98e937. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.023402 19736 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:57.024247 19738 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:16:57.024600 19738 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:16:57.024577 18874 catalog_manager.cc:5495] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } health_report { overall_health: UNKNOWN } } }
I20260812 11:16:57.067261 19724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.060705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.0.0.1:55474)
0812 11:16:57.060948 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.060970 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.061108 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.061822 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.061829 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.061858 (+ 29us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:57.062046 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.062054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.063565 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.063569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.064560 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.064573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.065335 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.065341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.065487 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.065547 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.066650 (+ 1103us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.066677 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.066761 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.066928 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:16:57.067262 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.060785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55474 (local address 127.15.164.194:37443)
0812 11:16:57.061076 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.061084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.061115 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:16:57.061424 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.061432 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.061548 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.061738 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.062195 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.063423 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.064710 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.065151 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.065306 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.065758 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.066530 (+ 772us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.066715 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.066796 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.066890 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260812 11:16:57.076197 19583 raft_consensus.cc:1261] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Refusing update from remote peer c54f23e963b34dc1a0ec7b3cba98e937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.076556 19132 raft_consensus.cc:1261] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Refusing update from remote peer c54f23e963b34dc1a0ec7b3cba98e937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.077200 19736 consensus_queue.cc:1035] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:57.077575 19703 consensus_queue.cc:1035] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:57.096728 19704 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: TxnStatusTablet state changed. Reason: New leader c54f23e963b34dc1a0ec7b3cba98e937. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.097059 19704 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:57.099094 19705 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: TxnStatusTablet state changed. Reason: New leader c54f23e963b34dc1a0ec7b3cba98e937. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.099450 19705 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:57.102098 19736 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.102386 19736 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:57.104931 19705 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.105237 19705 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P a1b75abcb32f4573892c61eacd1bef2d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:57.107620 19703 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.107933 19703 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P c54f23e963b34dc1a0ec7b3cba98e937: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:16:57.111768 19704 tablet_replica.cc:439] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } } }
I20260812 11:16:57.112056 19704 tablet_replica.cc:442] T 75519d2c12fc4b99aa29ec519a38a531 P 79b2b5aa4e474cd1a1c4ac177c422230: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:16:57.121326 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.114044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.15.164.195:36011)
0812 11:16:57.114243 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.114249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.115219 (+ 970us) server_negotiation.cc:407] Connection header received
0812 11:16:57.115344 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.115349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.115456 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.115618 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.116014 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.117193 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.118664 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.119316 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.119449 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.119833 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.120593 (+ 760us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.120756 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.120883 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.120979 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:16:57.139318 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.133542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:47353 (local address 127.15.164.194:37443)
0812 11:16:57.133809 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.133818 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.134211 (+ 393us) server_negotiation.cc:407] Connection header received
0812 11:16:57.134459 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.134504 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.134589 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.134720 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.135232 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.136038 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.137432 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.137853 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.138001 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.138532 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.138660 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.138761 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.138899 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.138982 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:16:57.139380 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.133469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.15.164.195:47353)
0812 11:16:57.134098 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.134115 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.134298 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.134745 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.134750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.134761 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:57.135053 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.135062 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.136187 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.136193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.137277 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.137289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.138038 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.138047 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.138194 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.138251 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.138762 (+ 511us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.138776 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.138872 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.139009 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":331,"threads_started":1}
I20260812 11:16:57.149897 19132 raft_consensus.cc:1261] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Refusing update from remote peer a1b75abcb32f4573892c61eacd1bef2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.150087 19361 raft_consensus.cc:1261] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Refusing update from remote peer a1b75abcb32f4573892c61eacd1bef2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.150660 19709 consensus_queue.cc:1035] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:57.151032 19705 consensus_queue.cc:1035] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:57.161816 19744 mvcc.cc:205] Tried to move back new op lower bound from 7317640876639178752 to 7317640874600701952. Current Snapshot: MvccSnapshot[applied={T|T < 7317640876639178752}]
I20260812 11:16:57.169180 19746 mvcc.cc:205] Tried to move back new op lower bound from 7317640876639178752 to 7317640874600701952. Current Snapshot: MvccSnapshot[applied={T|T < 7317640876639178752}]
I20260812 11:16:57.200692 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.188620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:46937 (local address 127.15.164.195:36011)
0812 11:16:57.188829 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.188836 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.194354 (+ 5518us) server_negotiation.cc:407] Connection header received
0812 11:16:57.194686 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.194692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.194796 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.194904 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.195618 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.196462 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.198304 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.198979 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.199058 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.199791 (+ 733us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.199928 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.199996 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.200268 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.200365 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:16:57.201403 19786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.188444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36011 (local address 127.15.164.194:46937)
0812 11:16:57.194239 (+ 5795us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.194261 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.194429 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.194927 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.194932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.194944 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:57.195394 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.195416 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.196673 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.196677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.198110 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.198124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.199256 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.199263 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.199480 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.199550 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.200085 (+ 535us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.200103 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.200938 (+ 835us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.201066 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5552,"thread_start_us":5366,"threads_started":1}
I20260812 11:16:57.244158 18873 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:57.244486 18873 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:57.249017 18873 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Sending DeleteTablet for 3 replicas of tablet 35f8851140ab4fbaa359c205a53f4e42
I20260812 11:16:57.250285 19100 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:57 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:41552
I20260812 11:16:57.250976 19327 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:57 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55470
I20260812 11:16:57.253016 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f8851140ab4fbaa359c205a53f4e42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:57 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55748
I20260812 11:16:57.252928 18874 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:57.254025 18874 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:57.256268 19794 tablet_replica.cc:330] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: stopping tablet replica
I20260812 11:16:57.256947 19794 raft_consensus.cc:2229] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:16:57.257769 19794 raft_consensus.cc:2258] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:57.260007 19794 ts_tablet_manager.cc:1905] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:57.260852 19791 tablet_replica.cc:330] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: stopping tablet replica
I20260812 11:16:57.261391 19791 raft_consensus.cc:2229] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:57.267011 19098 tablet_service.cc:1467] Processing CreateTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (DEFAULT_TABLE table=test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:57.267563 19098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:57.267781 19327 tablet_service.cc:1467] Processing CreateTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (DEFAULT_TABLE table=test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:57.268280 19327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:57.268349 19542 tablet_service.cc:1467] Processing CreateTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (DEFAULT_TABLE table=test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:57.268790 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:57.266831 19791 raft_consensus.cc:2258] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:57.277889 19791 ts_tablet_manager.cc:1905] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:57.284569 19796 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Bootstrap starting.
I20260812 11:16:57.285236 19795 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Bootstrap starting.
I20260812 11:16:57.286478 19798 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Bootstrap starting.
I20260812 11:16:57.287810 19795 tablet_bootstrap.cc:654] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:57.289870 19796 tablet_bootstrap.cc:654] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:57.291736 19798 tablet_bootstrap.cc:654] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:57.291446 19790 tablet_replica.cc:330] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: stopping tablet replica
I20260812 11:16:57.297596 19790 raft_consensus.cc:2229] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:57.298173 19790 raft_consensus.cc:2258] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:57.296638 19791 ts_tablet_manager.cc:1918] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:57.298381 19791 log.cc:1196] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/35f8851140ab4fbaa359c205a53f4e42
I20260812 11:16:57.299199 19791 ts_tablet_manager.cc:1939] T 35f8851140ab4fbaa359c205a53f4e42 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting consensus metadata
I20260812 11:16:57.299508 19796 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: No bootstrap required, opened a new log
I20260812 11:16:57.301023 19796 ts_tablet_manager.cc:1397] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260812 11:16:57.289740 19794 ts_tablet_manager.cc:1918] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:57.301450 19794 log.cc:1196] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/35f8851140ab4fbaa359c205a53f4e42
I20260812 11:16:57.301438 18845 catalog_manager.cc:4841] TS c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443): tablet 35f8851140ab4fbaa359c205a53f4e42 (table test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]) successfully deleted
I20260812 11:16:57.302085 19794 ts_tablet_manager.cc:1939] T 35f8851140ab4fbaa359c205a53f4e42 P a1b75abcb32f4573892c61eacd1bef2d: Deleting consensus metadata
I20260812 11:16:57.301954 19796 raft_consensus.cc:348] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.302207 19796 raft_consensus.cc:374] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:57.302788 19798 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: No bootstrap required, opened a new log
I20260812 11:16:57.303088 19798 ts_tablet_manager.cc:1397] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260812 11:16:57.304013 18841 catalog_manager.cc:4841] TS a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011): tablet 35f8851140ab4fbaa359c205a53f4e42 (table test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]) successfully deleted
I20260812 11:16:57.304164 19798 raft_consensus.cc:348] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.304509 19798 raft_consensus.cc:374] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:57.304524 19796 raft_consensus.cc:729] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Initialized, Role: FOLLOWER
I20260812 11:16:57.303551 19790 ts_tablet_manager.cc:1905] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:57.304720 19798 raft_consensus.cc:729] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Initialized, Role: FOLLOWER
I20260812 11:16:57.304832 19796 consensus_queue.cc:260] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.305588 19796 ts_tablet_manager.cc:1428] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260812 11:16:57.305028 19798 consensus_queue.cc:260] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.307456 19798 ts_tablet_manager.cc:1428] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:16:57.307771 19795 tablet_bootstrap.cc:492] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: No bootstrap required, opened a new log
I20260812 11:16:57.307953 19795 ts_tablet_manager.cc:1397] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260812 11:16:57.308861 19795 raft_consensus.cc:348] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.309156 19795 raft_consensus.cc:374] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:57.309259 19795 raft_consensus.cc:729] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Initialized, Role: FOLLOWER
I20260812 11:16:57.309535 19795 consensus_queue.cc:260] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.310201 19795 ts_tablet_manager.cc:1428] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 11:16:57.319468 19790 ts_tablet_manager.cc:1918] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:57.319684 19790 log.cc:1196] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/35f8851140ab4fbaa359c205a53f4e42
I20260812 11:16:57.320228 19790 ts_tablet_manager.cc:1939] T 35f8851140ab4fbaa359c205a53f4e42 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting consensus metadata
I20260812 11:16:57.322311 18841 catalog_manager.cc:4841] TS 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637): tablet 35f8851140ab4fbaa359c205a53f4e42 (table test-table [id=bb62e4ba7a014faeabffcf59cf241d4a]) successfully deleted
I20260812 11:16:57.322710 19757 raft_consensus.cc:482] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:57.322914 19757 raft_consensus.cc:504] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.323848 19757 leader_election.cc:288] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:57.324429 19130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09f77df41c9f4ddbbd8173d8b0fc5b18" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" is_pre_election: true
I20260812 11:16:57.324558 19583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09f77df41c9f4ddbbd8173d8b0fc5b18" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d" is_pre_election: true
I20260812 11:16:57.324695 19130 raft_consensus.cc:2454] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 0.
I20260812 11:16:57.324823 19583 raft_consensus.cc:2454] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 0.
I20260812 11:16:57.325256 19246 leader_election.cc:302] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:57.325551 19757 raft_consensus.cc:2781] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:57.325717 19757 raft_consensus.cc:482] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:57.325814 19757 raft_consensus.cc:3037] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.329457 19757 raft_consensus.cc:504] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.331379 19130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09f77df41c9f4ddbbd8173d8b0fc5b18" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
I20260812 11:16:57.331475 19757 leader_election.cc:288] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 election: Requested vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:57.331616 19130 raft_consensus.cc:3037] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.331598 19583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09f77df41c9f4ddbbd8173d8b0fc5b18" candidate_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d"
I20260812 11:16:57.331802 19583 raft_consensus.cc:3037] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:57.334823 19130 raft_consensus.cc:2454] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 1.
I20260812 11:16:57.334884 19583 raft_consensus.cc:2454] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54f23e963b34dc1a0ec7b3cba98e937 in term 1.
I20260812 11:16:57.335490 19246 leader_election.cc:302] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b75abcb32f4573892c61eacd1bef2d, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:57.336024 19757 raft_consensus.cc:2781] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:57.336565 19757 raft_consensus.cc:686] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 LEADER]: Becoming Leader. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Running, Role: LEADER
I20260812 11:16:57.336903 19757 consensus_queue.cc:237] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:57.340296 18872 catalog_manager.cc:5495] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } health_report { overall_health: UNKNOWN } } }
I20260812 11:16:57.371832 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.364490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.15.164.194:37443)
0812 11:16:57.364695 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.364702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.365009 (+ 307us) server_negotiation.cc:407] Connection header received
0812 11:16:57.365210 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.365215 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.365324 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.365434 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.365906 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.367280 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.369307 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.370188 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.370354 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.370859 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.371063 (+ 204us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.371182 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.371350 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.371454 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:16:57.391093 19786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.384114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.15.164.194:41103)
0812 11:16:57.384307 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:57.384327 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:57.384457 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:57.384871 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:57.384876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:57.384888 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:57.385113 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.385125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.386968 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.386974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.388685 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:57.388704 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.389727 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.389733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:57.389928 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.389984 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.390502 (+ 518us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.390514 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:16:57.390575 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:16:57.390749 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:16:57.391909 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:57.384057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:41103 (local address 127.15.164.194:37443)
0812 11:16:57.384296 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:57.384302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:57.384381 (+ 79us) server_negotiation.cc:407] Connection header received
0812 11:16:57.384641 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:57.384649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:57.384746 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:57.385242 (+ 496us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:57.385375 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.386651 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.388883 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:57.389542 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:57.390118 (+ 576us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:57.390222 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:57.390372 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:57.391468 (+ 1096us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:57.391540 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:16:57.391635 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 11:16:57.403445 19583 raft_consensus.cc:1261] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Refusing update from remote peer c54f23e963b34dc1a0ec7b3cba98e937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.404489 19130 raft_consensus.cc:1261] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Refusing update from remote peer c54f23e963b34dc1a0ec7b3cba98e937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:57.404397 19757 consensus_queue.cc:1035] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:57.405440 19736 consensus_queue.cc:1035] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:16:57.449148 19743 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:16:59.066818 18874 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:59.067124 18874 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:59.071893 18874 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Sending DeleteTablet for 3 replicas of tablet 09f77df41c9f4ddbbd8173d8b0fc5b18
I20260812 11:16:59.072906 19100 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:41552
I20260812 11:16:59.073058 19326 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55470
I20260812 11:16:59.073453 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55748
I20260812 11:16:59.073961 19847 tablet_replica.cc:330] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: stopping tablet replica
I20260812 11:16:59.074255 19847 raft_consensus.cc:2229] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:16:59.074348 19849 tablet_replica.cc:330] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: stopping tablet replica
I20260812 11:16:59.074661 19849 raft_consensus.cc:2229] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:59.074988 19849 raft_consensus.cc:2258] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.075027 19847 raft_consensus.cc:2258] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.076292 19849 ts_tablet_manager.cc:1905] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.078984 19845 tablet_replica.cc:330] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: stopping tablet replica
I20260812 11:16:59.079238 19845 raft_consensus.cc:2229] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:59.079450 19847 ts_tablet_manager.cc:1905] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.079545 19845 raft_consensus.cc:2258] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.080756 19845 ts_tablet_manager.cc:1905] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.084648 19849 ts_tablet_manager.cc:1918] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:16:59.084870 19849 log.cc:1196] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/09f77df41c9f4ddbbd8173d8b0fc5b18
I20260812 11:16:59.085682 19849 ts_tablet_manager.cc:1939] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P a1b75abcb32f4573892c61eacd1bef2d: Deleting consensus metadata
I20260812 11:16:59.087280 18841 catalog_manager.cc:4841] TS a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011): tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (table test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]) successfully deleted
I20260812 11:16:59.090605 19847 ts_tablet_manager.cc:1918] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:16:59.090730 19845 ts_tablet_manager.cc:1918] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:16:59.090775 19847 log.cc:1196] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/09f77df41c9f4ddbbd8173d8b0fc5b18
I20260812 11:16:59.090902 19845 log.cc:1196] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/09f77df41c9f4ddbbd8173d8b0fc5b18
I20260812 11:16:59.091276 19847 ts_tablet_manager.cc:1939] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting consensus metadata
I20260812 11:16:59.091405 19845 ts_tablet_manager.cc:1939] T 09f77df41c9f4ddbbd8173d8b0fc5b18 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting consensus metadata
I20260812 11:16:59.092584 18841 catalog_manager.cc:4841] TS 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637): tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (table test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]) successfully deleted
I20260812 11:16:59.092527 18845 catalog_manager.cc:4841] TS c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443): tablet 09f77df41c9f4ddbbd8173d8b0fc5b18 (table test-table [id=b6c2bc6a936d4ac7a3786d62cb3b2503]) successfully deleted
Aug 12 11:16:59 dist-test-slave-7kzw krb5kdc[18792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:16:59 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:16:59.135497 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.119855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57950 (local address 127.15.164.254:44251)
0812 11:16:59.120548 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.120553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.120578 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:16:59.120749 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.120754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.120823 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.120921 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:59.122390 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.123344 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.124790 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.125268 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.125388 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.129490 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:59.129496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:59.129500 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:59.129573 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:59.132678 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:59.133379 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:59.133384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:59.133387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:59.133522 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:59.133933 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:59.133937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:59.133939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:59.134243 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:59.134441 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.134920 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.135106 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":420,"threads_started":1}
I20260812 11:16:59.139472 18874 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:59.140091 18874 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:59.147178 19326 tablet_service.cc:1467] Processing CreateTablet for tablet fefeac38f80b47858c80b67cd1311ce8 (DEFAULT_TABLE table=test-table [id=0f158150cd0247f983a240e753f8013b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.147207 19100 tablet_service.cc:1467] Processing CreateTablet for tablet fefeac38f80b47858c80b67cd1311ce8 (DEFAULT_TABLE table=test-table [id=0f158150cd0247f983a240e753f8013b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.147689 19100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefeac38f80b47858c80b67cd1311ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.147710 19326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefeac38f80b47858c80b67cd1311ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.147658 19542 tablet_service.cc:1467] Processing CreateTablet for tablet fefeac38f80b47858c80b67cd1311ce8 (DEFAULT_TABLE table=test-table [id=0f158150cd0247f983a240e753f8013b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.148156 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefeac38f80b47858c80b67cd1311ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.154665 19861 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Bootstrap starting.
I20260812 11:16:59.155515 19865 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Bootstrap starting.
I20260812 11:16:59.156391 19863 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Bootstrap starting.
I20260812 11:16:59.157758 19865 tablet_bootstrap.cc:654] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.157835 19861 tablet_bootstrap.cc:654] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.158113 19863 tablet_bootstrap.cc:654] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.160385 19861 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: No bootstrap required, opened a new log
I20260812 11:16:59.160557 19861 ts_tablet_manager.cc:1397] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:16:59.160633 19863 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: No bootstrap required, opened a new log
I20260812 11:16:59.160809 19863 ts_tablet_manager.cc:1397] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 11:16:59.161120 19865 tablet_bootstrap.cc:492] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: No bootstrap required, opened a new log
I20260812 11:16:59.161360 19865 ts_tablet_manager.cc:1397] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:16:59.161432 19861 raft_consensus.cc:348] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.161688 19861 raft_consensus.cc:374] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.161794 19861 raft_consensus.cc:729] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.162048 19861 consensus_queue.cc:260] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.161955 19863 raft_consensus.cc:348] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.162322 19863 raft_consensus.cc:374] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.162427 19863 raft_consensus.cc:729] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.162766 19863 consensus_queue.cc:260] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.163024 19861 ts_tablet_manager.cc:1428] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:16:59.162941 19865 raft_consensus.cc:348] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.163296 19865 raft_consensus.cc:374] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.163498 19865 raft_consensus.cc:729] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.165676 19865 consensus_queue.cc:260] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.167718 19865 ts_tablet_manager.cc:1428] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 11:16:59.168622 19863 ts_tablet_manager.cc:1428] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260812 11:16:59.169214 19875 raft_consensus.cc:482] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:59.169518 19875 raft_consensus.cc:504] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.172154 19875 leader_election.cc:288] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:59.181773 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.172709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:52475 (local address 127.15.164.195:36011)
0812 11:16:59.174051 (+ 1342us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.174058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.175373 (+ 1315us) server_negotiation.cc:407] Connection header received
0812 11:16:59.175579 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.175588 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.175677 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.176398 (+ 721us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:59.176571 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.177606 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.179492 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.180325 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.180524 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.180608 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.180970 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.181147 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":817,"thread_start_us":900,"threads_started":1}
I20260812 11:16:59.181782 19882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.172308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36011 (local address 127.15.164.193:52475)
0812 11:16:59.175274 (+ 2966us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:59.175290 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:59.175446 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:59.175869 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:59.175874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:59.175904 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:59.176260 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.176270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.177738 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.177744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.179326 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.179342 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.180570 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.180578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.180797 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.180824 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:16:59.180939 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:16:59.181097 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2847,"thread_start_us":2603,"threads_started":1}
I20260812 11:16:59.182526 19582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fefeac38f80b47858c80b67cd1311ce8" candidate_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d" is_pre_election: true
I20260812 11:16:59.182858 19582 raft_consensus.cc:2454] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b2b5aa4e474cd1a1c4ac177c422230 in term 0.
I20260812 11:16:59.183459 19021 leader_election.cc:302] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, a1b75abcb32f4573892c61eacd1bef2d; no voters:
I20260812 11:16:59.183773 19888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.175313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41449 (local address 127.15.164.194:37443)
0812 11:16:59.176032 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.176038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.176928 (+ 890us) server_negotiation.cc:407] Connection header received
0812 11:16:59.177070 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.177075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.177147 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.177257 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:16:59.177884 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.178878 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.180765 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.182647 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.182874 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.182950 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.183245 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.183385 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":763,"threads_started":1}
I20260812 11:16:59.183889 19886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.175191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.15.164.193:41449)
0812 11:16:59.176821 (+ 1630us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:59.176838 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:59.176950 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:59.177284 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:59.177287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:59.177309 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:16:59.177639 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.177647 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.179025 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.179035 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.180579 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.180593 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.182874 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.182881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.183067 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.183111 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:16:59.183216 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:16:59.183367 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1474,"thread_start_us":1285,"threads_started":1}
I20260812 11:16:59.184104 19879 raft_consensus.cc:2781] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:59.184307 19879 raft_consensus.cc:482] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:59.184521 19879 raft_consensus.cc:3037] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.184798 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fefeac38f80b47858c80b67cd1311ce8" candidate_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" is_pre_election: true
I20260812 11:16:59.185026 19361 raft_consensus.cc:2454] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b2b5aa4e474cd1a1c4ac177c422230 in term 0.
I20260812 11:16:59.187474 19879 raft_consensus.cc:504] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.188414 19879 leader_election.cc:288] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [CANDIDATE]: Term 1 election: Requested vote from peers c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443), a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011)
I20260812 11:16:59.188894 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fefeac38f80b47858c80b67cd1311ce8" candidate_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
I20260812 11:16:59.189069 19582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fefeac38f80b47858c80b67cd1311ce8" candidate_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b75abcb32f4573892c61eacd1bef2d"
I20260812 11:16:59.189167 19361 raft_consensus.cc:3037] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.189311 19582 raft_consensus.cc:3037] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.192631 19582 raft_consensus.cc:2454] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b2b5aa4e474cd1a1c4ac177c422230 in term 1.
I20260812 11:16:59.192619 19361 raft_consensus.cc:2454] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b2b5aa4e474cd1a1c4ac177c422230 in term 1.
I20260812 11:16:59.193161 19023 leader_election.cc:302] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 79b2b5aa4e474cd1a1c4ac177c422230, a1b75abcb32f4573892c61eacd1bef2d, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:59.193602 19879 raft_consensus.cc:2781] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:59.193832 19879 raft_consensus.cc:686] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 LEADER]: Becoming Leader. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Running, Role: LEADER
I20260812 11:16:59.194386 19879 consensus_queue.cc:237] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.198454 18874 catalog_manager.cc:5495] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193). New cstate: current_term: 1 leader_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } health_report { overall_health: UNKNOWN } } }
I20260812 11:16:59.234512 19892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.228283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41564 (local address 127.15.164.193:45637)
0812 11:16:59.228939 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.228943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.228963 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:16:59.229052 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.229055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.229141 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.229344 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:59.229687 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.230593 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.231922 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.232693 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.232795 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.233234 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.233854 (+ 620us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.233971 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.234092 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.234160 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":415,"threads_started":1}
I20260812 11:16:59.250898 19888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.245307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53661 (local address 127.15.164.194:37443)
0812 11:16:59.245595 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.245604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.245855 (+ 251us) server_negotiation.cc:407] Connection header received
0812 11:16:59.246094 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.246098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.246165 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.246263 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:59.246901 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.247606 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.249089 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.249541 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.249676 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.250153 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.250264 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.250362 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.250517 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.250598 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:16:59.251019 19899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.245035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.15.164.193:53661)
0812 11:16:59.245756 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:59.245772 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:59.245936 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:59.246296 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:59.246300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:59.246312 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:59.246743 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.246757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.247743 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.247749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.248946 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.248958 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.249789 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.249795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.249914 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.249969 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.250363 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.250377 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 11:16:59.250498 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:16:59.250633 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":367,"threads_started":1}
I20260812 11:16:59.259915 19582 raft_consensus.cc:1261] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Refusing update from remote peer 79b2b5aa4e474cd1a1c4ac177c422230: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:59.259959 19361 raft_consensus.cc:1261] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Refusing update from remote peer 79b2b5aa4e474cd1a1c4ac177c422230: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:59.260785 19879 consensus_queue.cc:1035] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:59.261099 19875 consensus_queue.cc:1035] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:59.270198 19813 mvcc.cc:205] Tried to move back new op lower bound from 7317640885282942976 to 7317640885024825344. Current Snapshot: MvccSnapshot[applied={T|T < 7317640885282942976}]
I20260812 11:16:59.293349 19892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.287137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:34755 (local address 127.15.164.193:45637)
0812 11:16:59.287318 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.287323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.287972 (+ 649us) server_negotiation.cc:407] Connection header received
0812 11:16:59.288123 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.288127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.288209 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.288312 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:59.288890 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.289820 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.291466 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.291977 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.292126 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.292557 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.292702 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.292801 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.292962 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.293047 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:16:59.293555 19904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.287019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.15.164.194:34755)
0812 11:16:59.287886 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:59.287902 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:59.288017 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:59.288336 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:59.288339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:59.288350 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:16:59.288673 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.288687 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.289981 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.289990 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.291319 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:59.291334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.292161 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.292178 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:59.292307 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.292348 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.292819 (+ 471us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.292831 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:16:59.292929 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 11:16:59.293108 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":583,"threads_started":1}
I20260812 11:16:59.328841 18872 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:59.329123 18872 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:16:59.332429 18872 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Sending DeleteTablet for 3 replicas of tablet fefeac38f80b47858c80b67cd1311ce8
I20260812 11:16:59.333300 19100 tablet_service.cc:1514] Processing DeleteTablet for tablet fefeac38f80b47858c80b67cd1311ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:41552
I20260812 11:16:59.333644 19845 tablet_replica.cc:330] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: stopping tablet replica
I20260812 11:16:59.333751 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet fefeac38f80b47858c80b67cd1311ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55748
I20260812 11:16:59.333877 19845 raft_consensus.cc:2229] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:16:59.334048 19849 tablet_replica.cc:330] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: stopping tablet replica
I20260812 11:16:59.334261 19849 raft_consensus.cc:2229] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:59.334453 19845 raft_consensus.cc:2258] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.334497 19849 raft_consensus.cc:2258] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.335275 19326 tablet_service.cc:1514] Processing DeleteTablet for tablet fefeac38f80b47858c80b67cd1311ce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:16:59 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55470
I20260812 11:16:59.335566 19847 tablet_replica.cc:330] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: stopping tablet replica
I20260812 11:16:59.335726 19849 ts_tablet_manager.cc:1905] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.335776 19847 raft_consensus.cc:2229] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:16:59.335888 19845 ts_tablet_manager.cc:1905] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.335968 19847 raft_consensus.cc:2258] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:16:59.336628 18872 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:16:59.337338 18872 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:16:59.339491 19847 ts_tablet_manager.cc:1905] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:16:59.344476 19845 ts_tablet_manager.cc:1918] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:59.344794 19845 log.cc:1196] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/fefeac38f80b47858c80b67cd1311ce8
I20260812 11:16:59.345501 19845 ts_tablet_manager.cc:1939] T fefeac38f80b47858c80b67cd1311ce8 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting consensus metadata
I20260812 11:16:59.346566 19847 ts_tablet_manager.cc:1918] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:59.346746 19847 log.cc:1196] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/fefeac38f80b47858c80b67cd1311ce8
I20260812 11:16:59.346958 18841 catalog_manager.cc:4841] TS 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637): tablet fefeac38f80b47858c80b67cd1311ce8 (table test-table [id=0f158150cd0247f983a240e753f8013b]) successfully deleted
I20260812 11:16:59.347200 19847 ts_tablet_manager.cc:1939] T fefeac38f80b47858c80b67cd1311ce8 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting consensus metadata
I20260812 11:16:59.348398 18845 catalog_manager.cc:4841] TS c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443): tablet fefeac38f80b47858c80b67cd1311ce8 (table test-table [id=0f158150cd0247f983a240e753f8013b]) successfully deleted
I20260812 11:16:59.350587 19100 tablet_service.cc:1467] Processing CreateTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 (DEFAULT_TABLE table=test-table [id=952e56cc8c2644e0968598a841ade0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.350939 19326 tablet_service.cc:1467] Processing CreateTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 (DEFAULT_TABLE table=test-table [id=952e56cc8c2644e0968598a841ade0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.351080 19100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd9df64ffb4479e8e8a4a78d89c96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.351374 19326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd9df64ffb4479e8e8a4a78d89c96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.351965 19849 ts_tablet_manager.cc:1918] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:16:59.352276 19849 log.cc:1196] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/fefeac38f80b47858c80b67cd1311ce8
I20260812 11:16:59.352794 19849 ts_tablet_manager.cc:1939] T fefeac38f80b47858c80b67cd1311ce8 P a1b75abcb32f4573892c61eacd1bef2d: Deleting consensus metadata
I20260812 11:16:59.355506 19542 tablet_service.cc:1467] Processing CreateTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 (DEFAULT_TABLE table=test-table [id=952e56cc8c2644e0968598a841ade0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:16:59.355935 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcd9df64ffb4479e8e8a4a78d89c96e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:59.358016 19865 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: Bootstrap starting.
I20260812 11:16:59.358160 19863 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: Bootstrap starting.
I20260812 11:16:59.359877 19865 tablet_bootstrap.cc:654] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.360101 19863 tablet_bootstrap.cc:654] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.362581 19861 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Bootstrap starting.
I20260812 11:16:59.363145 18841 catalog_manager.cc:4841] TS a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011): tablet fefeac38f80b47858c80b67cd1311ce8 (table test-table [id=0f158150cd0247f983a240e753f8013b]) successfully deleted
I20260812 11:16:59.364682 19861 tablet_bootstrap.cc:654] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:59.366454 19863 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: No bootstrap required, opened a new log
I20260812 11:16:59.366720 19863 ts_tablet_manager.cc:1397] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:16:59.367810 19863 raft_consensus.cc:348] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.368180 19863 raft_consensus.cc:374] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.368294 19863 raft_consensus.cc:729] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b2b5aa4e474cd1a1c4ac177c422230, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.368726 19863 consensus_queue.cc:260] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.369467 19863 ts_tablet_manager.cc:1428] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:16:59.375255 19861 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: No bootstrap required, opened a new log
I20260812 11:16:59.375483 19861 ts_tablet_manager.cc:1397] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260812 11:16:59.376358 19861 raft_consensus.cc:348] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.376634 19861 raft_consensus.cc:374] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.376737 19861 raft_consensus.cc:729] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.376855 19865 tablet_bootstrap.cc:492] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: No bootstrap required, opened a new log
I20260812 11:16:59.377053 19865 ts_tablet_manager.cc:1397] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.005s
I20260812 11:16:59.377027 19861 consensus_queue.cc:260] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.377848 19865 raft_consensus.cc:348] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.378118 19865 raft_consensus.cc:374] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:59.378194 19865 raft_consensus.cc:729] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54f23e963b34dc1a0ec7b3cba98e937, State: Initialized, Role: FOLLOWER
I20260812 11:16:59.378213 19861 ts_tablet_manager.cc:1428] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 11:16:59.378445 19865 consensus_queue.cc:260] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.379082 19865 ts_tablet_manager.cc:1428] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 11:16:59.512733 19874 raft_consensus.cc:482] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:16:59.513017 19874 raft_consensus.cc:504] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.513863 19874 leader_election.cc:288] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443)
I20260812 11:16:59.514629 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd9df64ffb4479e8e8a4a78d89c96e2" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" is_pre_election: true
I20260812 11:16:59.514598 19130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd9df64ffb4479e8e8a4a78d89c96e2" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" is_pre_election: true
I20260812 11:16:59.514887 19361 raft_consensus.cc:2454] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 0.
I20260812 11:16:59.514900 19130 raft_consensus.cc:2454] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 0.
I20260812 11:16:59.515394 19475 leader_election.cc:302] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b75abcb32f4573892c61eacd1bef2d, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:59.515722 19874 raft_consensus.cc:2781] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:16:59.515858 19874 raft_consensus.cc:482] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:16:59.515964 19874 raft_consensus.cc:3037] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.518411 19874 raft_consensus.cc:504] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.519315 19874 leader_election.cc:288] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 election: Requested vote from peers 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637), c54f23e963b34dc1a0ec7b3cba98e937 (127.15.164.194:37443)
I20260812 11:16:59.519933 19130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd9df64ffb4479e8e8a4a78d89c96e2" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b2b5aa4e474cd1a1c4ac177c422230"
I20260812 11:16:59.520042 19361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd9df64ffb4479e8e8a4a78d89c96e2" candidate_uuid: "a1b75abcb32f4573892c61eacd1bef2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54f23e963b34dc1a0ec7b3cba98e937"
I20260812 11:16:59.520164 19130 raft_consensus.cc:3037] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.520246 19361 raft_consensus.cc:3037] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:59.523269 19361 raft_consensus.cc:2454] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 1.
I20260812 11:16:59.523723 19130 raft_consensus.cc:2454] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b75abcb32f4573892c61eacd1bef2d in term 1.
I20260812 11:16:59.523792 19475 leader_election.cc:302] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b75abcb32f4573892c61eacd1bef2d, c54f23e963b34dc1a0ec7b3cba98e937; no voters:
I20260812 11:16:59.524251 19874 raft_consensus.cc:2781] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:59.530774 19874 raft_consensus.cc:686] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 1 LEADER]: Becoming Leader. State: Replica: a1b75abcb32f4573892c61eacd1bef2d, State: Running, Role: LEADER
I20260812 11:16:59.531198 19874 consensus_queue.cc:237] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } }
I20260812 11:16:59.534349 18873 catalog_manager.cc:5495] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195). New cstate: current_term: 1 leader_uuid: "a1b75abcb32f4573892c61eacd1bef2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b75abcb32f4573892c61eacd1bef2d" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36011 } health_report { overall_health: HEALTHY } } }
I20260812 11:16:59.584673 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:59.579013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55760 (local address 127.15.164.195:36011)
0812 11:16:59.579217 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:59.579236 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:59.579258 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:16:59.579441 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:59.579447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:59.579533 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:59.579637 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:59.579969 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.581078 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.582644 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:59.583199 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:59.583351 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:59.583869 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:59.583988 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:59.584096 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:59.584249 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:16:59.584335 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:16:59.595968 19130 raft_consensus.cc:1261] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Refusing update from remote peer a1b75abcb32f4573892c61eacd1bef2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:59.596045 19361 raft_consensus.cc:1261] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Refusing update from remote peer a1b75abcb32f4573892c61eacd1bef2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:59.596745 19874 consensus_queue.cc:1035] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54f23e963b34dc1a0ec7b3cba98e937" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:59.597082 19911 consensus_queue.cc:1035] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b2b5aa4e474cd1a1c4ac177c422230" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:16:59.619565 19819 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:17:01.266769 18872 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:01.267212 18872 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:01.271834 18872 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75d90c2e93e04c29a43b3bd030d88e5a: Sending DeleteTablet for 3 replicas of tablet bcd9df64ffb4479e8e8a4a78d89c96e2
I20260812 11:17:01.272848 19100 tablet_service.cc:1514] Processing DeleteTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:01 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:41552
I20260812 11:17:01.272987 19542 tablet_service.cc:1514] Processing DeleteTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:01 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55748
I20260812 11:17:01.273034 19326 tablet_service.cc:1514] Processing DeleteTablet for tablet bcd9df64ffb4479e8e8a4a78d89c96e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:01 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55470
I20260812 11:17:01.273661 19959 tablet_replica.cc:330] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: stopping tablet replica
I20260812 11:17:01.273775 19960 tablet_replica.cc:330] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: stopping tablet replica
I20260812 11:17:01.273995 19959 raft_consensus.cc:2229] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:01.274053 19960 raft_consensus.cc:2229] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:01.274356 19959 raft_consensus.cc:2258] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:01.274446 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18998
I20260812 11:17:01.274837 19960 raft_consensus.cc:2258] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:01.276232 19961 tablet_replica.cc:330] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: stopping tablet replica
I20260812 11:17:01.276539 19961 raft_consensus.cc:2229] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:01.276885 19961 raft_consensus.cc:2258] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:01.277155 19959 ts_tablet_manager.cc:1905] T bcd9df64ffb4479e8e8a4a78d89c96e2 P 79b2b5aa4e474cd1a1c4ac177c422230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:01.278080 19961 ts_tablet_manager.cc:1905] T bcd9df64ffb4479e8e8a4a78d89c96e2 P c54f23e963b34dc1a0ec7b3cba98e937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:01.281304 19960 ts_tablet_manager.cc:1905] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:01.306906 19963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.276558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41576 (local address 127.15.164.193:45637)
0812 11:17:01.283718 (+ 7160us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:01.283724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:01.283745 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:17:01.283811 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:01.283817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:01.283902 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:01.284022 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:01.285538 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.286461 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.287842 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.288343 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.288450 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:01.299664 (+ 11214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:01.299685 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:01.299705 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:01.299761 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:01.303504 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.304431 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.304440 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.304442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.304592 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.305070 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.305075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.305077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.305595 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:01.305885 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:01.306201 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 11:17:01.306400 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7003,"thread_start_us":6857,"threads_started":1}
W20260812 11:17:01.307847 19189 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41576
W20260812 11:17:01.308600 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18998: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:01.308821 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18998
I20260812 11:17:01.378238 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19212
W20260812 11:17:01.378289 18841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.164.193:45637 (error 108)
I20260812 11:17:01.380841 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.379812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41584)
0812 11:17:01.380417 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.380596 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":312,"threads_started":1}
W20260812 11:17:01.381104 18841 catalog_manager.cc:4584] TS 79b2b5aa4e474cd1a1c4ac177c422230 (127.15.164.193:45637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bcd9df64ffb4479e8e8a4a78d89c96e2: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:17:01.397190 19968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.379181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.15.164.194:37443)
0812 11:17:01.379724 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:01.379731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:01.380137 (+ 406us) server_negotiation.cc:407] Connection header received
0812 11:17:01.380379 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:01.380404 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:01.380486 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:01.380601 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:01.382330 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.383255 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.384669 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.385199 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.385337 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:01.390011 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:01.390037 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:01.390057 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:01.390104 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:01.393618 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.394499 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.394514 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.394518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.394686 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.395262 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.395271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.395275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.395758 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:01.396092 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:01.396595 (+ 503us) server_negotiation.cc:299] Negotiation successful
0812 11:17:01.396889 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":776,"threads_started":1}
W20260812 11:17:01.398038 19431 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55494
W20260812 11:17:01.398876 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19212: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:01.399024 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19212
I20260812 11:17:01.434986 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.434355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41600)
0812 11:17:01.434704 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.434827 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260812 11:17:01.436451 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.435997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41610)
0812 11:17:01.436198 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.436298 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 11:17:01.452036 19960 ts_tablet_manager.cc:1918] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:17:01.452262 19960 log.cc:1196] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/bcd9df64ffb4479e8e8a4a78d89c96e2
I20260812 11:17:01.452764 19960 ts_tablet_manager.cc:1939] T bcd9df64ffb4479e8e8a4a78d89c96e2 P a1b75abcb32f4573892c61eacd1bef2d: Deleting consensus metadata
I20260812 11:17:01.454293 18841 catalog_manager.cc:4841] TS a1b75abcb32f4573892c61eacd1bef2d (127.15.164.195:36011): tablet bcd9df64ffb4479e8e8a4a78d89c96e2 (table test-table [id=952e56cc8c2644e0968598a841ade0fe]) successfully deleted
I20260812 11:17:01.485196 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19447
I20260812 11:17:01.485909 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.485395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.0.0.1:55500)
0812 11:17:01.485585 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.485706 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.194:37443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[18792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:17:01.497853 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.497349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41626)
0812 11:17:01.497558 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.497639 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 11:17:01.499143 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.498701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45637 (local address 127.0.0.1:41636)
0812 11:17:01.498944 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.499019 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260812 11:17:01.503515 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.486112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55770 (local address 127.15.164.195:36011)
0812 11:17:01.486843 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:01.486848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:01.486864 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:17:01.486920 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:01.486924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:01.486990 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:01.487083 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:01.488501 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.489264 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.490723 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:01.491152 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:01.491271 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:01.496465 (+ 5194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:01.496483 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:01.496501 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:01.496548 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:01.500230 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.501133 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.501150 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.501152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.501318 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:01.501793 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:01.501798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:01.501800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:01.502244 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:01.502589 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:01.502931 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 11:17:01.503120 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":459,"threads_started":1}
W20260812 11:17:01.504384 19657 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55770
W20260812 11:17:01.505090 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19447: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:01.505285 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19447
I20260812 11:17:01.519027 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.518382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.0.0.1:55516)
0812 11:17:01.518664 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.518785 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.194:37443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260812 11:17:01.520318 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:01.519827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37443 (local address 127.0.0.1:55520)
0812 11:17:01.520042 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:01.520153 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.194:37443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:17:01.542748 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18810
I20260812 11:17:01.544100 18946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:01.672247 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18810
2026-08-12T11:17:01Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9263 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[19978](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[19978](info): set up 2 sockets
Aug 12 11:17:01 dist-test-slave-7kzw krb5kdc[19978](info): commencing operation
krb5kdc: starting...
W20260812 11:17:03.184250 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.451s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:03 dist-test-slave-7kzw krb5kdc[19978](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:03.418946 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45217
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:45217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:03.788862 20000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:03.789247 20000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:03.789430 20000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:03.796648 20000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:03.796828 20000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:03.796945 20000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:03.797055 20000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:03.797144 20000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:03.807376 20000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:45217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:03.808948 20000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:03.810366 20000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:03.825870 20006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:03.826043 20000 server_base.cc:1034] running on GCE node
W20260812 11:17:03.825709 20010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:03.825801 20007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:03.827451 20000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:03.829123 20000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:03.830565 20000 hybrid_clock.cc:648] HybridClock initialized: now 1786533423830396 us; error 103 us; skew 500 ppm
I20260812 11:17:03.831085 20000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:03 dist-test-slave-7kzw krb5kdc[19978](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533423, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:03.835014 20000 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:03.837157 20000 webserver.cc:460] Webserver started at http://127.15.164.254:44075/ using document root <none> and password file <none>
I20260812 11:17:03.837976 20000 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:03.838137 20000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:03.838600 20000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:03.841843 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "d0b590615a0142a39194004a73eeae6d"
format_stamp: "Formatted at 2026-08-12 11:17:03 on dist-test-slave-7kzw"
server_key: "a50344a51c3498ac44fb1d2d4285b4ee"
server_key_iv: "90238756750349a1a63b5904bc551f80"
server_key_version: "encryptionkey@0"
I20260812 11:17:03.842757 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "d0b590615a0142a39194004a73eeae6d"
format_stamp: "Formatted at 2026-08-12 11:17:03 on dist-test-slave-7kzw"
server_key: "a50344a51c3498ac44fb1d2d4285b4ee"
server_key_iv: "90238756750349a1a63b5904bc551f80"
server_key_version: "encryptionkey@0"
I20260812 11:17:03.848817 20000 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:17:03.852768 20024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:03.854298 20000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:17:03.854581 20000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "d0b590615a0142a39194004a73eeae6d"
format_stamp: "Formatted at 2026-08-12 11:17:03 on dist-test-slave-7kzw"
server_key: "a50344a51c3498ac44fb1d2d4285b4ee"
server_key_iv: "90238756750349a1a63b5904bc551f80"
server_key_version: "encryptionkey@0"
I20260812 11:17:03.854858 20000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:03.880373 20000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:03.885353 20000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:03.885686 20000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:03.906929 20000 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:45217
I20260812 11:17:03.906978 20115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:45217 every 8 connection(s)
I20260812 11:17:03.908444 20000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:03.912734 20116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:03.914950 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20000
I20260812 11:17:03.915199 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:03.915845 16019 external_mini_cluster.cc:1428] Setting key 8f296e8f361eb2866ed1370768af9ec4
I20260812 11:17:03.926693 20116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d: Bootstrap starting.
I20260812 11:17:03.931281 20116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d: Neither blocks nor log segments found. Creating new log.
Aug 12 11:17:03 dist-test-slave-7kzw krb5kdc[19978](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:03.932634 20116 log.cc:824] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:03.936645 20116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d: No bootstrap required, opened a new log
I20260812 11:17:03.943851 20122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:03.918026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41132 (local address 127.15.164.254:45217)
0812 11:17:03.918920 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:03.918931 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:03.918981 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:17:03.920681 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:03.920705 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:03.921094 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:03.921418 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:03.923538 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:03.925132 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:03.927200 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:03.927987 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:03.928187 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:03.933574 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:03.933584 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:03.933608 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:03.933651 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:03.938338 (+ 4687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:03.939270 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:03.939280 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:03.939290 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:03.939543 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:03.940030 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:03.940036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:03.940041 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:03.940885 (+ 844us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:03.941267 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:03.941695 (+ 428us) server_negotiation.cc:299] Negotiation successful
0812 11:17:03.942189 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":390,"threads_started":1}
I20260812 11:17:03.947796 20116 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } }
I20260812 11:17:03.948235 20116 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:03.948370 20116 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0b590615a0142a39194004a73eeae6d, State: Initialized, Role: FOLLOWER
I20260812 11:17:03.949048 20116 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } }
I20260812 11:17:03.949319 20116 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:03.949466 20116 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:03.949697 20116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:03.952818 20116 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } }
I20260812 11:17:03.953404 20116 leader_election.cc:302] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0b590615a0142a39194004a73eeae6d; no voters:
I20260812 11:17:03.954022 20116 leader_election.cc:288] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:03.954200 20125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:03.954952 20125 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [term 1 LEADER]: Becoming Leader. State: Replica: d0b590615a0142a39194004a73eeae6d, State: Running, Role: LEADER
I20260812 11:17:03.955546 20125 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } }
I20260812 11:17:03.956367 20116 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:03.958489 20128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0b590615a0142a39194004a73eeae6d. Latest consensus state: current_term: 1 leader_uuid: "d0b590615a0142a39194004a73eeae6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } } }
I20260812 11:17:03.958902 20128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:03.959292 20126 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0b590615a0142a39194004a73eeae6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0b590615a0142a39194004a73eeae6d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45217 } } }
I20260812 11:17:03.959854 20126 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:03.961689 20132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:03.967480 20132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:03.976624 20132 catalog_manager.cc:1347] Generated new cluster ID: 78982bc86a2e4611b31974943b5db3ac
I20260812 11:17:03.976758 20132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:03.988431 20132 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:03.990505 20132 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:04.004953 20132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0b590615a0142a39194004a73eeae6d: Generated new TSK 0
I20260812 11:17:04.006206 20132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:04.067027 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:04.416829 20159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:04.417209 20159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:04.417395 20159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:04.424976 20159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:04.425150 20159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:04.425339 20159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:04.435981 20159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:04.437410 20159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:04.438973 20159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:04.452865 20168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:04.452996 20169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:04.453507 20173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:04.454133 20159 server_base.cc:1034] running on GCE node
I20260812 11:17:04.454903 20159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:04.456019 20159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:04.457273 20159 hybrid_clock.cc:648] HybridClock initialized: now 1786533424457208 us; error 56 us; skew 500 ppm
I20260812 11:17:04.457639 20159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:04 dist-test-slave-7kzw krb5kdc[19978](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533424, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:04.471306 20159 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:04.473166 20159 webserver.cc:460] Webserver started at http://127.15.164.193:33107/ using document root <none> and password file <none>
I20260812 11:17:04.474092 20159 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:04.474246 20159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:04.474655 20159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:04.477891 20159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "17ec8826d9304cc5905bbe14fb3ffdee"
format_stamp: "Formatted at 2026-08-12 11:17:04 on dist-test-slave-7kzw"
server_key: "229b4c3c9daea7741a6fc7fb5de4eec1"
server_key_iv: "22d3f310cad1c453f8cc71facb210520"
server_key_version: "encryptionkey@0"
I20260812 11:17:04.478797 20159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "17ec8826d9304cc5905bbe14fb3ffdee"
format_stamp: "Formatted at 2026-08-12 11:17:04 on dist-test-slave-7kzw"
server_key: "229b4c3c9daea7741a6fc7fb5de4eec1"
server_key_iv: "22d3f310cad1c453f8cc71facb210520"
server_key_version: "encryptionkey@0"
I20260812 11:17:04.484198 20159 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:17:04.487910 20187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:04.489220 20159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:04.489426 20159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "17ec8826d9304cc5905bbe14fb3ffdee"
format_stamp: "Formatted at 2026-08-12 11:17:04 on dist-test-slave-7kzw"
server_key: "229b4c3c9daea7741a6fc7fb5de4eec1"
server_key_iv: "22d3f310cad1c453f8cc71facb210520"
server_key_version: "encryptionkey@0"
I20260812 11:17:04.489671 20159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:04.507606 20159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:04.512737 20159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:04.513072 20159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:04.514142 20159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:04.515790 20159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:04.515911 20159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:04.516074 20159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:04.516148 20159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:04.552896 20159 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:43341
I20260812 11:17:04.552944 20370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:43341 every 8 connection(s)
I20260812 11:17:04.554793 20159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:04.561616 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20159
I20260812 11:17:04.561873 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:04.562645 16019 external_mini_cluster.cc:1428] Setting key 08b16616b7848d5e3045edd177cec4eb
Aug 12 11:17:04 dist-test-slave-7kzw krb5kdc[19978](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533424, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:04.590864 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:04.560881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:46857 (local address 127.15.164.254:45217)
0812 11:17:04.564524 (+ 3643us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:04.564530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:04.564554 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:17:04.564751 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:04.564758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:04.564845 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:04.564961 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:04.568944 (+ 3983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:04.570172 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:04.573214 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:04.573723 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:04.573851 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:04.579324 (+ 5473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:04.579335 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:04.579343 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:04.579395 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:04.586068 (+ 6673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:04.587328 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:04.587337 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:04.587343 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:04.587530 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:04.588226 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:04.588233 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:04.588238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:04.588657 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:04.588836 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:04.590097 (+ 1261us) server_negotiation.cc:299] Negotiation successful
0812 11:17:04.590383 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3486,"thread_start_us":3519,"threads_started":1}
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:17:04.592738 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:04.560024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45217 (local address 127.15.164.193:46857)
0812 11:17:04.561127 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:04.561179 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:04.564363 (+ 3184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:04.566774 (+ 2411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:04.566794 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:04.567778 (+ 984us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:04.568712 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:04.568758 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:04.570453 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:04.570497 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:04.573001 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:04.573022 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:04.573995 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:04.574004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:04.574364 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:04.575304 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:04.575346 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:04.578981 (+ 3635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:04.586285 (+ 7304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:04.586301 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:04.586325 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:04.587134 (+ 809us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:04.587695 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:04.587703 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:04.587710 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:04.588059 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:04.588825 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:04.588838 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:04.589495 (+ 657us) client_negotiation.cc:769] Sending connection context
0812 11:17:04.589934 (+ 439us) client_negotiation.cc:240] Negotiation successful
0812 11:17:04.590728 (+ 794us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":533,"threads_started":1}
I20260812 11:17:04.594662 20371 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45217
I20260812 11:17:04.595120 20371 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
I20260812 11:17:04.596235 20371 heartbeater.cc:511] Master 127.15.164.254:45217 requested a full tablet report, sending...
I20260812 11:17:04.599984 20052 ts_manager.cc:194] Registered new tserver with Master: 17ec8826d9304cc5905bbe14fb3ffdee (127.15.164.193:43341)
I20260812 11:17:04.602603 20052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:46857
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:04.635195 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:04.984912 20384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:04.985282 20384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:04.985462 20384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:04.993237 20384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:04.993415 20384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:04.993611 20384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:05.004166 20384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:05.005779 20384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:05.007400 20384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:05.022111 20395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:05.022154 20391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:05.022173 20390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:05.023473 20384 server_base.cc:1034] running on GCE node
I20260812 11:17:05.024253 20384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:05.025264 20384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:05.026567 20384 hybrid_clock.cc:648] HybridClock initialized: now 1786533425026500 us; error 59 us; skew 500 ppm
I20260812 11:17:05.026954 20384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:05 dist-test-slave-7kzw krb5kdc[19978](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:05.030274 20384 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:05.032047 20384 webserver.cc:460] Webserver started at http://127.15.164.194:45683/ using document root <none> and password file <none>
I20260812 11:17:05.032860 20384 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:05.033017 20384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:05.033357 20384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:05.036450 20384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "b911deaba3af4d68baa5c91f1ef6c894"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "1cc298241bc4b0e71192a4ff41c5e9d9"
server_key_iv: "adcb0dbd10d335a7ce70571390d815ea"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.037282 20384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "b911deaba3af4d68baa5c91f1ef6c894"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "1cc298241bc4b0e71192a4ff41c5e9d9"
server_key_iv: "adcb0dbd10d335a7ce70571390d815ea"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.042856 20384 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 11:17:05.046867 20406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.048437 20384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:05.048645 20384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "b911deaba3af4d68baa5c91f1ef6c894"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "1cc298241bc4b0e71192a4ff41c5e9d9"
server_key_iv: "adcb0dbd10d335a7ce70571390d815ea"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.048868 20384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:05.061508 20384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:05.066200 20384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:05.066572 20384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:05.067603 20384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:05.069018 20384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:05.069128 20384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.069278 20384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:05.069353 20384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.104766 20384 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:36095
I20260812 11:17:05.104859 20581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:36095 every 8 connection(s)
I20260812 11:17:05.106137 20384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:05.109310 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20384
I20260812 11:17:05.109529 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:05.109993 16019 external_mini_cluster.cc:1428] Setting key 36e8b20e31ee9acd3bb88ed56befc3f3
Aug 12 11:17:05 dist-test-slave-7kzw krb5kdc[19978](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:05.127624 20586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:05.108956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:58761 (local address 127.15.164.254:45217)
0812 11:17:05.109602 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:05.109610 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:05.110730 (+ 1120us) server_negotiation.cc:407] Connection header received
0812 11:17:05.112929 (+ 2199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:05.112935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:05.113029 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:05.113150 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:05.114857 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.115583 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.117161 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.117585 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.117733 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:05.121538 (+ 3805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:05.121543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:05.121546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:05.121580 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:05.124352 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:05.125140 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:05.125145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:05.125147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:05.125285 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:05.125737 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:05.125744 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:05.125752 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:05.126019 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:05.126200 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:05.126994 (+ 794us) server_negotiation.cc:299] Negotiation successful
0812 11:17:05.127224 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":335,"threads_started":1}
I20260812 11:17:05.128583 20593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:05.109571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45217 (local address 127.15.164.194:58761)
0812 11:17:05.110524 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:05.110585 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:05.112641 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:05.113410 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:05.113419 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:05.113961 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:05.114679 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:05.114700 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.115749 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.115755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:05.116999 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:05.117012 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.117835 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.117844 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:05.118088 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:05.118870 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:05.118894 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:05.121289 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:05.124516 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:05.124526 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:05.124544 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:05.124998 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:05.125404 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:05.125409 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:05.125413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:05.125610 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:05.126173 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:05.126182 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:05.126588 (+ 406us) client_negotiation.cc:769] Sending connection context
0812 11:17:05.126872 (+ 284us) client_negotiation.cc:240] Negotiation successful
0812 11:17:05.127433 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":362,"threads_started":1}
I20260812 11:17:05.130057 20583 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45217
I20260812 11:17:05.130430 20583 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:17:05.131318 20583 heartbeater.cc:511] Master 127.15.164.254:45217 requested a full tablet report, sending...
I20260812 11:17:05.133040 20052 ts_manager.cc:194] Registered new tserver with Master: b911deaba3af4d68baa5c91f1ef6c894 (127.15.164.194:36095)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
I20260812 11:17:05.133986 20052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:58761
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:05.162392 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:05.514153 20599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:05.514484 20599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:05.514645 20599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:05.521787 20599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:05.521898 20599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:05.522081 20599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:05.532084 20599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:05.533529 20599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:05.535040 20599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:05.547978 20605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:05.548750 20606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:05.549476 20608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:05.550588 20599 server_base.cc:1034] running on GCE node
I20260812 11:17:05.551313 20599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:05.552416 20599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:05.553704 20599 hybrid_clock.cc:648] HybridClock initialized: now 1786533425553645 us; error 57 us; skew 500 ppm
I20260812 11:17:05.554102 20599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:05 dist-test-slave-7kzw krb5kdc[19978](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:05.557571 20599 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:17:05.559465 20599 webserver.cc:460] Webserver started at http://127.15.164.195:39935/ using document root <none> and password file <none>
I20260812 11:17:05.560439 20599 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:05.560583 20599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:05.560930 20599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:05.564179 20599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "be290597f0fe40a2bd7edf718bb9acc3"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "a024434d89b199c684822d3003dbbe7d"
server_key_iv: "c77b9dbfa7e4dde8a14a2dc9df0e8e35"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.565019 20599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "be290597f0fe40a2bd7edf718bb9acc3"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "a024434d89b199c684822d3003dbbe7d"
server_key_iv: "c77b9dbfa7e4dde8a14a2dc9df0e8e35"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.570703 20599 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 11:17:05.575047 20623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.576781 20599 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:17:05.576984 20599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "be290597f0fe40a2bd7edf718bb9acc3"
format_stamp: "Formatted at 2026-08-12 11:17:05 on dist-test-slave-7kzw"
server_key: "a024434d89b199c684822d3003dbbe7d"
server_key_iv: "c77b9dbfa7e4dde8a14a2dc9df0e8e35"
server_key_version: "encryptionkey@0"
I20260812 11:17:05.577196 20599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:05.597507 20599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:05.601768 20599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:05.602087 20599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:05.603230 20599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:05.604707 20599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:05.604784 20599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.604924 20599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:05.604979 20599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:05.606312 20371 heartbeater.cc:503] Master 127.15.164.254:45217 was elected leader, sending a full tablet report...
I20260812 11:17:05.640007 20599 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:45983
I20260812 11:17:05.640069 20826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:45983 every 8 connection(s)
I20260812 11:17:05.641451 20599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:05.645008 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20599
I20260812 11:17:05.645236 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:05.645690 16019 external_mini_cluster.cc:1428] Setting key 8a0e6967a39bb3ecaea8071a29f19457
Aug 12 11:17:05 dist-test-slave-7kzw krb5kdc[19978](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533425, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:05.665352 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:05.644245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:60369 (local address 127.15.164.254:45217)
0812 11:17:05.644785 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:05.644792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:05.645898 (+ 1106us) server_negotiation.cc:407] Connection header received
0812 11:17:05.648258 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:05.648262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:05.648351 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:05.648436 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:05.650294 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.651211 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.652848 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.653319 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.653426 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:05.657203 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:05.657209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:05.657212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:05.657249 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:05.660509 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:05.661638 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:05.661665 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:05.661668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:05.661841 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:05.662564 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:05.662571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:05.662577 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:05.663108 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:05.663349 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:05.664409 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0812 11:17:05.664750 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":230,"threads_started":1}
I20260812 11:17:05.666530 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:05.644832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45217 (local address 127.15.164.195:60369)
0812 11:17:05.645701 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:05.645750 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:05.647930 (+ 2180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:05.648745 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:05.648757 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:05.649488 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:05.650123 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:05.650142 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.651360 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.651365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:05.652708 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:05.652721 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:05.653552 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:05.653562 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:05.653793 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:05.654452 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:05.654533 (+ 81us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:05.656915 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:05.660731 (+ 3816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:05.660742 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:05.660762 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:05.661466 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:05.661998 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:05.662007 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:05.662012 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:05.662375 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:05.663295 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:05.663306 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:05.663855 (+ 549us) client_negotiation.cc:769] Sending connection context
0812 11:17:05.664239 (+ 384us) client_negotiation.cc:240] Negotiation successful
0812 11:17:05.664918 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":352,"threads_started":1}
I20260812 11:17:05.668306 20827 heartbeater.cc:347] Connected to a master server at 127.15.164.254:45217
I20260812 11:17:05.668787 20827 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:05.669813 20827 heartbeater.cc:511] Master 127.15.164.254:45217 requested a full tablet report, sending...
I20260812 11:17:05.671700 20052 ts_manager.cc:194] Registered new tserver with Master: be290597f0fe40a2bd7edf718bb9acc3 (127.15.164.195:45983)
I20260812 11:17:05.672619 20052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:60369
I20260812 11:17:05.674865 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:17:05.710296 20829 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:05.707555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.15.164.254:45217)
0812 11:17:05.707781 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:05.707786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:05.708294 (+ 508us) server_negotiation.cc:407] Connection header received
0812 11:17:05.708445 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:05.708449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:05.708533 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:05.708659 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:05.709897 (+ 1238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41142: BlockingRecv error: recv got EOF from 127.0.0.1:41142 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 11:17:05.713500 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20159
W20260812 11:17:05.716773 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20159: Not authorized: Client connection negotiation failed: client connection to 127.15.164.193:43341: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:17:05.716976 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20159
I20260812 11:17:05.744148 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20384
W20260812 11:17:05.747205 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20384: Not authorized: Client connection negotiation failed: client connection to 127.15.164.194:36095: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:17:05.747416 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20384
I20260812 11:17:05.771473 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20599
W20260812 11:17:05.774675 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20599: Not authorized: Client connection negotiation failed: client connection to 127.15.164.195:45983: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:17:05.774816 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20599
I20260812 11:17:05.801465 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20000
I20260812 11:17:05.802917 20108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:05.908805 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20000
2026-08-12T11:17:05Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4227 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:06 dist-test-slave-7kzw krb5kdc[20853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:06 dist-test-slave-7kzw krb5kdc[20853](info): set up 2 sockets
Aug 12 11:17:06 dist-test-slave-7kzw krb5kdc[20853](info): commencing operation
krb5kdc: starting...
W20260812 11:17:07.247296 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:07 dist-test-slave-7kzw krb5kdc[20853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:07.474295 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40011
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:07.829950 20874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:07.830261 20874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:07.830353 20874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:07.837539 20874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:07.837656 20874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:07.837705 20874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:07.837764 20874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:07.837811 20874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:07.847658 20874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:07.848935 20874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:07.850281 20874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:07.862740 20886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:07.862777 20884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:07.862812 20889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:07.863603 20874 server_base.cc:1034] running on GCE node
I20260812 11:17:07.864460 20874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:07.865861 20874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:07.867108 20874 hybrid_clock.cc:648] HybridClock initialized: now 1786533427867074 us; error 43 us; skew 500 ppm
I20260812 11:17:07.867483 20874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:07 dist-test-slave-7kzw krb5kdc[20853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533427, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:07.875228 20874 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:07.876863 20874 webserver.cc:460] Webserver started at http://127.15.164.254:41309/ using document root <none> and password file <none>
I20260812 11:17:07.877588 20874 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:07.877739 20874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:07.878072 20874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:07.881173 20874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "07493003273d4dd893c29273656c656b"
format_stamp: "Formatted at 2026-08-12 11:17:07 on dist-test-slave-7kzw"
server_key: "294ec135866a4f4ed0bd8a1c783a4749"
server_key_iv: "cb811f6ba57cca335957aab80ceb1afd"
server_key_version: "encryptionkey@0"
I20260812 11:17:07.881976 20874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "07493003273d4dd893c29273656c656b"
format_stamp: "Formatted at 2026-08-12 11:17:07 on dist-test-slave-7kzw"
server_key: "294ec135866a4f4ed0bd8a1c783a4749"
server_key_iv: "cb811f6ba57cca335957aab80ceb1afd"
server_key_version: "encryptionkey@0"
I20260812 11:17:07.887480 20874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:17:07.891467 20898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:07.892877 20874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:17:07.893095 20874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "07493003273d4dd893c29273656c656b"
format_stamp: "Formatted at 2026-08-12 11:17:07 on dist-test-slave-7kzw"
server_key: "294ec135866a4f4ed0bd8a1c783a4749"
server_key_iv: "cb811f6ba57cca335957aab80ceb1afd"
server_key_version: "encryptionkey@0"
I20260812 11:17:07.893308 20874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:07.910620 20874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:07.915095 20874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:07.915414 20874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:07.936139 20874 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40011
I20260812 11:17:07.936185 20978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40011 every 8 connection(s)
I20260812 11:17:07.937631 20874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:07.941557 20979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:07.947824 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20874
I20260812 11:17:07.948058 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:07.948935 16019 external_mini_cluster.cc:1428] Setting key 0364eb1fac406564fa97a03652106d63
I20260812 11:17:07.953720 20979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: Bootstrap starting.
I20260812 11:17:07.957043 20979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:07.958143 20979 log.cc:824] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:07.961431 20979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: No bootstrap required, opened a new log
Aug 12 11:17:07 dist-test-slave-7kzw krb5kdc[20853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:07.970611 20979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } }
I20260812 11:17:07.971024 20979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:07.971159 20979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07493003273d4dd893c29273656c656b, State: Initialized, Role: FOLLOWER
I20260812 11:17:07.971877 20979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } }
I20260812 11:17:07.972169 20979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:07.972326 20979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:07.972560 20979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:07.975389 20984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:07.951156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.15.164.254:40011)
0812 11:17:07.952123 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:07.952137 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:07.952187 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:17:07.954341 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:07.954366 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:07.954863 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:07.955316 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:07.957024 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:07.958725 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:07.960434 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:07.961219 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:07.961362 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:07.966311 (+ 4949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:07.966324 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:07.966345 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:07.966386 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:07.969977 (+ 3591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:07.970879 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:07.970887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:07.970894 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:07.971166 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:07.971628 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:07.971633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:07.971636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:07.972431 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:07.972758 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:07.973503 (+ 745us) server_negotiation.cc:299] Negotiation successful
0812 11:17:07.973993 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":469,"threads_started":1}
I20260812 11:17:07.975903 20979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } }
I20260812 11:17:07.976511 20979 leader_election.cc:302] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07493003273d4dd893c29273656c656b; no voters:
I20260812 11:17:07.977232 20979 leader_election.cc:288] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:07.977403 20988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:07.978500 20988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [term 1 LEADER]: Becoming Leader. State: Replica: 07493003273d4dd893c29273656c656b, State: Running, Role: LEADER
I20260812 11:17:07.979192 20988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } }
I20260812 11:17:07.979739 20979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:07.980543 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:17:07.985193 20989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07493003273d4dd893c29273656c656b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } } }
I20260812 11:17:07.985176 20990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07493003273d4dd893c29273656c656b. Latest consensus state: current_term: 1 leader_uuid: "07493003273d4dd893c29273656c656b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07493003273d4dd893c29273656c656b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40011 } } }
I20260812 11:17:07.985742 20989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:07.985772 20990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b [sys.catalog]: This master's current role is: LEADER
W20260812 11:17:08.001792 21011 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:17:08.001961 21011 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:17:08.002094 20997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:08.004192 20997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:08.014832 20997 catalog_manager.cc:1347] Generated new cluster ID: 11d32b5ee3364e44a4b4168aac8894ba
I20260812 11:17:08.014969 20997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:08.043141 20984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:08.033355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.15.164.254:40011)
0812 11:17:08.033544 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:08.033550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:08.034105 (+ 555us) server_negotiation.cc:407] Connection header received
0812 11:17:08.034306 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:08.034312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:08.034404 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:08.034574 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:08.035760 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:08.036926 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:08.038738 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:08.039447 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:08.039592 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:08.040846 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:08.040853 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:08.040860 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:08.042101 (+ 1241us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:08.042190 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:08.042229 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:08.042358 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:08.042609 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 11:17:08.042733 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":68}
I20260812 11:17:08.047902 20997 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:08.050154 20997 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:08.064754 20997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07493003273d4dd893c29273656c656b: Generated new TSK 0
I20260812 11:17:08.066066 20997 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:17:08.081279 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20874
I20260812 11:17:08.082811 20970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:08.178252 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20874
2026-08-12T11:17:08Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2266 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:08 dist-test-slave-7kzw krb5kdc[21033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:08 dist-test-slave-7kzw krb5kdc[21033](info): set up 2 sockets
Aug 12 11:17:08 dist-test-slave-7kzw krb5kdc[21033](info): commencing operation
krb5kdc: starting...
W20260812 11:17:09.550668 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:09 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:09.800608 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:46105
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:46105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:10.174360 21052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:10.174849 21052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:10.175012 21052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:10.182587 21052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:10.182737 21052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:10.182848 21052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:10.182952 21052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:10.183022 21052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:10.193449 21052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:46105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:46105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:10.195027 21052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:10.196448 21052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:10.211014 21061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:10.211071 21063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:10.211087 21060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:10.212056 21052 server_base.cc:1034] running on GCE node
I20260812 11:17:10.213002 21052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:10.214699 21052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:10.215955 21052 hybrid_clock.cc:648] HybridClock initialized: now 1786533430215901 us; error 35 us; skew 500 ppm
I20260812 11:17:10.216416 21052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:10 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533430, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:10.220604 21052 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:10.222604 21052 webserver.cc:460] Webserver started at http://127.15.164.254:35759/ using document root <none> and password file <none>
I20260812 11:17:10.223423 21052 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:10.223592 21052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:10.223942 21052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:10.227345 21052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "e1c74a76ed544f0fba2501309f9ab3d0"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "ab36b643f5d21329cac87db09450a9f3"
server_key_iv: "1a49f4844571a561dfbf75c9813124e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.228199 21052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "e1c74a76ed544f0fba2501309f9ab3d0"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "ab36b643f5d21329cac87db09450a9f3"
server_key_iv: "1a49f4844571a561dfbf75c9813124e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.234000 21052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:17:10.238304 21074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:10.239893 21052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:10.240139 21052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "e1c74a76ed544f0fba2501309f9ab3d0"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "ab36b643f5d21329cac87db09450a9f3"
server_key_iv: "1a49f4844571a561dfbf75c9813124e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.240365 21052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:10.258018 21052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:10.263388 21052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:10.263739 21052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:10.283680 21052 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:46105
I20260812 11:17:10.283753 21170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:46105 every 8 connection(s)
I20260812 11:17:10.285279 21052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:10.286242 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 21052
I20260812 11:17:10.286530 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:10.287253 16019 external_mini_cluster.cc:1428] Setting key 811c9c69dff83903e0e2579abe7a83d9
I20260812 11:17:10.290094 21171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:17:10 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:10.303925 21171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0: Bootstrap starting.
I20260812 11:17:10.308518 21171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:10.309844 21171 log.cc:824] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:10.313805 21171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0: No bootstrap required, opened a new log
I20260812 11:17:10.314390 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:10.289536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.15.164.254:46105)
0812 11:17:10.290444 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:10.290483 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:10.290540 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:17:10.292843 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:10.292872 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:10.293399 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:10.293863 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:10.295424 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.297520 (+ 2096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.298962 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.300029 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.300228 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:10.304912 (+ 4684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:10.304923 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:10.304943 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:10.304996 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:10.309281 (+ 4285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:10.310224 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:10.310234 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:10.310243 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:10.310526 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:10.311049 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:10.311053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:10.311055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:10.311786 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:10.312113 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:10.312537 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 11:17:10.313013 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":360,"threads_started":1}
I20260812 11:17:10.322083 21171 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } }
I20260812 11:17:10.322563 21171 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:10.322693 21171 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c74a76ed544f0fba2501309f9ab3d0, State: Initialized, Role: FOLLOWER
I20260812 11:17:10.323366 21171 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } }
I20260812 11:17:10.323616 21171 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:10.323766 21171 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:10.323958 21171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:10.326376 21171 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } }
I20260812 11:17:10.327061 21171 leader_election.cc:302] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c74a76ed544f0fba2501309f9ab3d0; no voters:
I20260812 11:17:10.327759 21171 leader_election.cc:288] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:10.327944 21177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:10.328734 21177 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [term 1 LEADER]: Becoming Leader. State: Replica: e1c74a76ed544f0fba2501309f9ab3d0, State: Running, Role: LEADER
I20260812 11:17:10.329531 21177 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } }
I20260812 11:17:10.330783 21171 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:10.332813 21178 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c74a76ed544f0fba2501309f9ab3d0. Latest consensus state: current_term: 1 leader_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } } }
I20260812 11:17:10.333259 21178 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:10.334275 21183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:10.334115 21179 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c74a76ed544f0fba2501309f9ab3d0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46105 } } }
I20260812 11:17:10.334666 21179 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:10.342630 21183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:10.355508 21183 catalog_manager.cc:1347] Generated new cluster ID: 0edc30d62c364716aef1fee97c497e23
I20260812 11:17:10.355716 21183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:10.377148 21183 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:10.379319 21183 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:10.394299 21183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1c74a76ed544f0fba2501309f9ab3d0: Generated new TSK 0
I20260812 11:17:10.395557 21183 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:10.454111 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:10.819917 21210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:10.820219 21210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:10.820324 21210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:10.827839 21210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:10.827953 21210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:10.828066 21210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:10.838562 21210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:10.839915 21210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:10.841256 21210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:10.855944 21221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:10.856338 21224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:10.856381 21220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:10.856976 21210 server_base.cc:1034] running on GCE node
I20260812 11:17:10.857769 21210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:10.858887 21210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:10.860134 21210 hybrid_clock.cc:648] HybridClock initialized: now 1786533430860078 us; error 35 us; skew 500 ppm
I20260812 11:17:10.860514 21210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:10 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533430, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:10.864130 21210 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:10.865713 21210 webserver.cc:460] Webserver started at http://127.15.164.193:46679/ using document root <none> and password file <none>
I20260812 11:17:10.866559 21210 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:10.866680 21210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:10.866962 21210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:10.869964 21210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "55afe737512e4d48ad1f88f070f62f9b"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "2c10b43cf9caa7e00f5286305569bf11"
server_key_iv: "eb16df7791cb03dac5689bb86d82f4a6"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.870824 21210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "55afe737512e4d48ad1f88f070f62f9b"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "2c10b43cf9caa7e00f5286305569bf11"
server_key_iv: "eb16df7791cb03dac5689bb86d82f4a6"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.876787 21210 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:10.880591 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:10.882089 21210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:17:10.882367 21210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "55afe737512e4d48ad1f88f070f62f9b"
format_stamp: "Formatted at 2026-08-12 11:17:10 on dist-test-slave-7kzw"
server_key: "2c10b43cf9caa7e00f5286305569bf11"
server_key_iv: "eb16df7791cb03dac5689bb86d82f4a6"
server_key_version: "encryptionkey@0"
I20260812 11:17:10.882706 21210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:10.899276 21210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:10.904233 21210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:10.904696 21210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:10.905895 21210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:10.908048 21210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:10.908191 21210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:10.908356 21210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:10.908445 21210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:10.949381 21210 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:36245
I20260812 11:17:10.949427 21407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:36245 every 8 connection(s)
I20260812 11:17:10.951040 21210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:10.958171 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 21210
I20260812 11:17:10.958433 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:10.959247 16019 external_mini_cluster.cc:1428] Setting key 063a9e16d3e08dca2578ac1a7f43953b
Aug 12 11:17:10 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533430, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:10.973363 21412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:10.954100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53559 (local address 127.15.164.254:46105)
0812 11:17:10.954676 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:10.954681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:10.955720 (+ 1039us) server_negotiation.cc:407] Connection header received
0812 11:17:10.957582 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:10.957588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:10.957681 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:10.957803 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:10.959544 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.960438 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.962427 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.962941 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.963087 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:10.966694 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:10.966700 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:10.966703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:10.966743 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:10.969614 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:10.970732 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:10.970736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:10.970739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:10.970881 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:10.971447 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:10.971451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:10.971453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:10.971763 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:10.971886 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:10.972906 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0812 11:17:10.973093 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":255,"threads_started":1}
I20260812 11:17:10.975026 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:10.954756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46105 (local address 127.15.164.193:53559)
0812 11:17:10.955547 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:10.955595 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:10.957307 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:10.958056 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:10.958064 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:10.958736 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:10.959356 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:10.959390 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.960614 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.960620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:10.962248 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:10.962267 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:10.963193 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:10.963200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:10.963456 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:10.964174 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:10.964198 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:10.966411 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:10.969775 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:10.969785 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:10.969804 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:10.970531 (+ 727us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:10.971007 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:10.971015 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:10.971022 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:10.971311 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:10.971903 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:10.971915 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:10.972422 (+ 507us) client_negotiation.cc:769] Sending connection context
0812 11:17:10.972776 (+ 354us) client_negotiation.cc:240] Negotiation successful
0812 11:17:10.973411 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":326,"threads_started":1}
I20260812 11:17:10.976775 21408 heartbeater.cc:347] Connected to a master server at 127.15.164.254:46105
I20260812 11:17:10.977126 21408 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:10.978168 21408 heartbeater.cc:511] Master 127.15.164.254:46105 requested a full tablet report, sending...
I20260812 11:17:10.980981 21104 ts_manager.cc:194] Registered new tserver with Master: 55afe737512e4d48ad1f88f070f62f9b (127.15.164.193:36245)
I20260812 11:17:10.982664 21104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:53559
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:11.016718 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:11.384042 21418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:11.384428 21418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:11.384601 21418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:11.392374 21418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:11.392544 21418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:11.392722 21418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:11.403921 21418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:11.405403 21418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:11.407028 21418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:11.421393 21425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:11.421430 21427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:11.421486 21424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:11.424180 21418 server_base.cc:1034] running on GCE node
I20260812 11:17:11.424897 21418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:11.425864 21418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:11.427155 21418 hybrid_clock.cc:648] HybridClock initialized: now 1786533431427106 us; error 41 us; skew 500 ppm
I20260812 11:17:11.427536 21418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:11 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533431, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:11.431015 21418 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:11.432611 21418 webserver.cc:460] Webserver started at http://127.15.164.194:33485/ using document root <none> and password file <none>
I20260812 11:17:11.433394 21418 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:11.433549 21418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:11.433885 21418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:11.437011 21418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "0af31d0577f1441d999d39a35932a141"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "e48e25d199afb085055644d280a82834"
server_key_iv: "c43b73b99a528e6a03616d4e072c2520"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.437846 21418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "0af31d0577f1441d999d39a35932a141"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "e48e25d199afb085055644d280a82834"
server_key_iv: "c43b73b99a528e6a03616d4e072c2520"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.443421 21418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 11:17:11.447304 21436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:11.448843 21418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:11.449036 21418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "0af31d0577f1441d999d39a35932a141"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "e48e25d199afb085055644d280a82834"
server_key_iv: "c43b73b99a528e6a03616d4e072c2520"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.449288 21418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:11.460959 21418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:11.465400 21418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:11.465725 21418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:11.466818 21418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:11.468225 21418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:11.468334 21418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:11.468494 21418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:11.468578 21418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:11.504681 21418 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:39147
I20260812 11:17:11.504714 21619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:39147 every 8 connection(s)
I20260812 11:17:11.506177 21418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:11.511674 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 21418
I20260812 11:17:11.511883 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:11.512382 16019 external_mini_cluster.cc:1428] Setting key cea40ffbb3859aaf2f7c6ef8aa82021e
Aug 12 11:17:11 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533431, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:11.527942 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:11.509100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:48899 (local address 127.15.164.254:46105)
0812 11:17:11.509620 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:11.509627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:11.510636 (+ 1009us) server_negotiation.cc:407] Connection header received
0812 11:17:11.512620 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:11.512628 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:11.512724 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:11.512849 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:11.514437 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:11.515252 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:11.516853 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:11.517405 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:11.517563 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:11.521774 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:11.521780 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:11.521783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:11.521819 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:11.524576 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:11.525409 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:11.525414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:11.525417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:11.525556 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:11.526022 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:11.526030 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:11.526033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:11.526316 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:11.526476 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:11.527259 (+ 783us) server_negotiation.cc:299] Negotiation successful
0812 11:17:11.527524 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":248,"threads_started":1}
I20260812 11:17:11.529093 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:11.509641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46105 (local address 127.15.164.194:48899)
0812 11:17:11.510413 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:11.510452 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:11.512297 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:11.513101 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:11.513110 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:11.513638 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:11.514246 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:11.514265 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:11.515424 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:11.515430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:11.516689 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:11.516707 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:11.517681 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:11.517689 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:11.517971 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:11.518797 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:11.518829 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:11.521483 (+ 2654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:11.524751 (+ 3268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:11.524764 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:11.524785 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:11.525261 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:11.525678 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:11.525683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:11.525687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:11.525899 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:11.526454 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:11.526489 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:11.526871 (+ 382us) client_negotiation.cc:769] Sending connection context
0812 11:17:11.527172 (+ 301us) client_negotiation.cc:240] Negotiation successful
0812 11:17:11.527778 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":284,"threads_started":1}
I20260812 11:17:11.530745 21620 heartbeater.cc:347] Connected to a master server at 127.15.164.254:46105
I20260812 11:17:11.531106 21620 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:11.531993 21620 heartbeater.cc:511] Master 127.15.164.254:46105 requested a full tablet report, sending...
I20260812 11:17:11.533586 21104 ts_manager.cc:194] Registered new tserver with Master: 0af31d0577f1441d999d39a35932a141 (127.15.164.194:39147)
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:17:11.534614 21104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:48899
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:11.568836 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:41211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:11.918008 21630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:11.918308 21630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:11.918406 21630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:11.925956 21630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:11.926074 21630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:11.926187 21630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:11.936465 21630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:11.937736 21630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:11.939069 21630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:11.952706 21639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:11.953872 21643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:11.953905 21640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:11.955623 21630 server_base.cc:1034] running on GCE node
I20260812 11:17:11.956295 21630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:11.957320 21630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:11.958565 21630 hybrid_clock.cc:648] HybridClock initialized: now 1786533431958523 us; error 33 us; skew 500 ppm
I20260812 11:17:11.958909 21630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:11 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533431, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:11.962239 21630 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:17:11.963907 21630 webserver.cc:460] Webserver started at http://127.15.164.195:33109/ using document root <none> and password file <none>
I20260812 11:17:11.964664 21630 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:11.964812 21630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:11.965137 21630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:11.968199 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "a709fdb01cf04ef9b5ebb5263ed658cd"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "c4f471e9ab41ff5bf9efd2eaf53e9958"
server_key_iv: "3ce6413cb31b67c9db24395ef66291e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.969018 21630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "a709fdb01cf04ef9b5ebb5263ed658cd"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "c4f471e9ab41ff5bf9efd2eaf53e9958"
server_key_iv: "3ce6413cb31b67c9db24395ef66291e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.974309 21630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:17:11.977837 21653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:11.979230 21630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:11.979410 21630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "a709fdb01cf04ef9b5ebb5263ed658cd"
format_stamp: "Formatted at 2026-08-12 11:17:11 on dist-test-slave-7kzw"
server_key: "c4f471e9ab41ff5bf9efd2eaf53e9958"
server_key_iv: "3ce6413cb31b67c9db24395ef66291e5"
server_key_version: "encryptionkey@0"
I20260812 11:17:11.979630 21630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:11.985879 21408 heartbeater.cc:503] Master 127.15.164.254:46105 was elected leader, sending a full tablet report...
I20260812 11:17:12.004504 21630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:12.009135 21630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:12.009446 21630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:12.010453 21630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:12.011910 21630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:12.012018 21630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:12.012168 21630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:12.012257 21630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:12.049355 21630 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:40443
I20260812 11:17:12.049373 21846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:40443 every 8 connection(s)
I20260812 11:17:12.050770 21630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:12.053119 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 21630
I20260812 11:17:12.053304 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:12.053987 16019 external_mini_cluster.cc:1428] Setting key eede5bc3816bd571d3c5f8c0df14b372
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533431, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:12.072230 21851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.053709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:51885 (local address 127.15.164.254:46105)
0812 11:17:12.054243 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:12.054250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:12.055541 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 11:17:12.057573 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:12.057577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:12.057650 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:12.057746 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:12.059412 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.060198 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.061733 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.062125 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.062238 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.065853 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:12.065858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:12.065861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:12.065894 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:12.069152 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.070001 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.070005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.070007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.070135 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.070605 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.070609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.070611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.070909 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:12.071032 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:12.071776 (+ 744us) server_negotiation.cc:299] Negotiation successful
0812 11:17:12.071937 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":231,"threads_started":1}
I20260812 11:17:12.073202 21852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.054460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46105 (local address 127.15.164.195:51885)
0812 11:17:12.055378 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:12.055426 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:12.057314 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:12.058002 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:12.058011 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:12.058657 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:12.059245 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:12.059263 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.060350 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.060354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:12.061601 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:12.061615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.062336 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.062341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:12.062623 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.063297 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:12.063332 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:12.065629 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:12.069320 (+ 3691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:12.069329 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:12.069345 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:12.069872 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:12.070235 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:12.070239 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:12.070241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:12.070426 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:12.071056 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:12.071063 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:12.071420 (+ 357us) client_negotiation.cc:769] Sending connection context
0812 11:17:12.071659 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 11:17:12.072046 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":357,"threads_started":1}
I20260812 11:17:12.074529 21847 heartbeater.cc:347] Connected to a master server at 127.15.164.254:46105
I20260812 11:17:12.074867 21847 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:12.075562 21847 heartbeater.cc:511] Master 127.15.164.254:46105 requested a full tablet report, sending...
I20260812 11:17:12.077073 21104 ts_manager.cc:194] Registered new tserver with Master: a709fdb01cf04ef9b5ebb5263ed658cd (127.15.164.195:40443)
I20260812 11:17:12.077937 21104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:51885
I20260812 11:17:12.082300 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533432, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533432, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:12.137630 21851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.123383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.15.164.254:46105)
0812 11:17:12.123613 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:12.123618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:12.124072 (+ 454us) server_negotiation.cc:407] Connection header received
0812 11:17:12.124277 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:12.124282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:12.124385 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:12.124496 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:12.125872 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.126795 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.128126 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.128564 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.128671 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.132658 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:12.132663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:12.132667 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:12.132702 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:12.135298 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.135902 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.135906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.135908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.136031 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.136405 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.136408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.136410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.136756 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:12.136934 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:12.137203 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 11:17:12.137375 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
W20260812 11:17:12.138293 21104 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52540
I20260812 11:17:12.140631 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21210
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533432, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:12.157959 21866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.141644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51476 (local address 127.15.164.193:36245)
0812 11:17:12.142291 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:12.142298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:12.142324 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:17:12.142383 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:12.142389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:12.142683 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:12.142818 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:12.144229 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.145330 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.146749 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.147379 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.147547 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.152026 (+ 4479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:12.152038 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:12.152052 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:12.152095 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:12.155275 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.155925 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.155934 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.155936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.156078 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.156434 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.156437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.156439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.156814 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:12.157070 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:12.157323 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 11:17:12.157524 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":334,"threads_started":1}
W20260812 11:17:12.159402 21400 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51476
W20260812 11:17:12.160501 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21210: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:12.160691 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 21210
I20260812 11:17:12.189713 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21418
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533432, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:17:12.207690 21867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.190763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.15.164.194:39147)
0812 11:17:12.191328 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:12.191335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:12.191362 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:17:12.191425 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:12.191432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:12.191665 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:12.191858 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:12.193191 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.194234 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.195645 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.196370 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.196555 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.201452 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:12.201465 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:12.201482 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:12.201520 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:12.204613 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.205358 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.205366 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.205368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.205496 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.205918 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.205922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.205924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.206287 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:12.206641 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:12.206968 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 11:17:12.207295 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":276,"threads_started":1}
W20260812 11:17:12.209184 21615 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55016
W20260812 11:17:12.210366 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21418: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:12.210572 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 21418
I20260812 11:17:12.240859 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21630
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533432, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:17:12.259568 21871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:12.242158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59328 (local address 127.15.164.195:40443)
0812 11:17:12.242954 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:12.242962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:12.242995 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:17:12.243084 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:12.243091 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:12.243312 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:12.243457 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:12.245035 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.246271 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.247672 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:12.248261 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:12.248374 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:12.253251 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:12.253265 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:12.253282 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:12.253320 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:12.256436 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.257128 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.257136 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.257139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.257269 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:12.257730 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:12.257733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:12.257735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:12.258113 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:12.258356 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:12.258937 (+ 581us) server_negotiation.cc:299] Negotiation successful
0812 11:17:12.259152 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":446,"threads_started":1}
W20260812 11:17:12.260982 21839 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59328
W20260812 11:17:12.262250 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21630: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:17:12.262439 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 21630
I20260812 11:17:12.288398 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21052
I20260812 11:17:12.289741 21159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:12.395963 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 21052
2026-08-12T11:17:12Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4223 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21877](info): set up 2 sockets
Aug 12 11:17:12 dist-test-slave-7kzw krb5kdc[21877](info): commencing operation
krb5kdc: starting...
W20260812 11:17:13.804867 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.354s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:13 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:14.062945 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40075
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:14.423945 21899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:14.424299 21899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:14.424512 21899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:14.432868 21899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:14.433004 21899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:14.433116 21899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:14.433214 21899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:14.433283 21899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:14.443928 21899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:14.445652 21899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:14.447235 21899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:14.460045 21908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:14.460095 21907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:14.460700 21912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:14.460819 21899 server_base.cc:1034] running on GCE node
I20260812 11:17:14.461758 21899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:14.463426 21899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:14.464675 21899 hybrid_clock.cc:648] HybridClock initialized: now 1786533434464627 us; error 62 us; skew 500 ppm
I20260812 11:17:14.465062 21899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:14 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533434, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:14.473587 21899 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:14.475498 21899 webserver.cc:460] Webserver started at http://127.15.164.254:46311/ using document root <none> and password file <none>
I20260812 11:17:14.476334 21899 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:14.476503 21899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:14.476871 21899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:14.480296 21899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "b36ed5190db544a1bc4cd30562c06cc5"
format_stamp: "Formatted at 2026-08-12 11:17:14 on dist-test-slave-7kzw"
server_key: "c5a2881a4fa61c9e6571d6d3046083e2"
server_key_iv: "2a4c283f27a498996f6a36e6f7837483"
server_key_version: "encryptionkey@0"
I20260812 11:17:14.481185 21899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "b36ed5190db544a1bc4cd30562c06cc5"
format_stamp: "Formatted at 2026-08-12 11:17:14 on dist-test-slave-7kzw"
server_key: "c5a2881a4fa61c9e6571d6d3046083e2"
server_key_iv: "2a4c283f27a498996f6a36e6f7837483"
server_key_version: "encryptionkey@0"
I20260812 11:17:14.487239 21899 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:17:14.491060 21925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:14.492579 21899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:17:14.492846 21899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "b36ed5190db544a1bc4cd30562c06cc5"
format_stamp: "Formatted at 2026-08-12 11:17:14 on dist-test-slave-7kzw"
server_key: "c5a2881a4fa61c9e6571d6d3046083e2"
server_key_iv: "2a4c283f27a498996f6a36e6f7837483"
server_key_version: "encryptionkey@0"
I20260812 11:17:14.493078 21899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:14.529238 21899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:14.534317 21899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:14.534711 21899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:14.556562 21899 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40075
I20260812 11:17:14.556571 22002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40075 every 8 connection(s)
I20260812 11:17:14.558138 21899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:14.559075 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 21899
I20260812 11:17:14.559367 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:14.559989 16019 external_mini_cluster.cc:1428] Setting key ef88a230658c36b44f5bfcf92e4aa9c8
I20260812 11:17:14.563504 22005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:17:14 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:14.578857 22005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5: Bootstrap starting.
I20260812 11:17:14.583824 22005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:14.585363 22005 log.cc:824] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:14.588575 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:14.562123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59156 (local address 127.15.164.254:40075)
0812 11:17:14.563114 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:14.563131 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:14.563195 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:17:14.565803 (+ 2608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:14.565836 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:14.566386 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:14.566956 (+ 570us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:14.568492 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:14.570937 (+ 2445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:14.572662 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:14.573811 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:14.574027 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:14.578554 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:14.578571 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:14.578595 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:14.578651 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:14.583354 (+ 4703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:14.584309 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:14.584321 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:14.584337 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:14.584588 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:14.585026 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:14.585032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:14.585036 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:14.585886 (+ 850us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:14.586295 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:14.586873 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 11:17:14.587486 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":377,"threads_started":1}
I20260812 11:17:14.588919 22005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5: No bootstrap required, opened a new log
I20260812 11:17:14.597361 22005 raft_consensus.cc:348] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } }
I20260812 11:17:14.597796 22005 raft_consensus.cc:374] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:14.597915 22005 raft_consensus.cc:729] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36ed5190db544a1bc4cd30562c06cc5, State: Initialized, Role: FOLLOWER
I20260812 11:17:14.598677 22005 consensus_queue.cc:260] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } }
I20260812 11:17:14.598977 22005 raft_consensus.cc:388] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:14.599128 22005 raft_consensus.cc:482] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:14.599342 22005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:14.601567 22005 raft_consensus.cc:504] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } }
I20260812 11:17:14.602142 22005 leader_election.cc:302] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b36ed5190db544a1bc4cd30562c06cc5; no voters:
I20260812 11:17:14.602854 22005 leader_election.cc:288] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:14.603010 22011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:14.603768 22011 raft_consensus.cc:686] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [term 1 LEADER]: Becoming Leader. State: Replica: b36ed5190db544a1bc4cd30562c06cc5, State: Running, Role: LEADER
I20260812 11:17:14.604380 22011 consensus_queue.cc:237] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } }
I20260812 11:17:14.605119 22005 sys_catalog.cc:564] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:14.609696 22014 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b36ed5190db544a1bc4cd30562c06cc5. Latest consensus state: current_term: 1 leader_uuid: "b36ed5190db544a1bc4cd30562c06cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } } }
I20260812 11:17:14.610265 22014 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:14.610932 22012 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b36ed5190db544a1bc4cd30562c06cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b36ed5190db544a1bc4cd30562c06cc5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40075 } } }
I20260812 11:17:14.611240 22012 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:14.611604 22025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:14.618531 22025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:14.629561 22025 catalog_manager.cc:1347] Generated new cluster ID: 34c89104ef0649ec909beae0a11cb3ec
I20260812 11:17:14.629702 22025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:14.658273 22025 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:14.660521 22025 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:14.669821 22025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b36ed5190db544a1bc4cd30562c06cc5: Generated new TSK 0
I20260812 11:17:14.671083 22025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:14.742656 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:15.114337 22043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:15.114709 22043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:15.114905 22043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:15.122270 22043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:15.122392 22043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:15.122598 22043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:15.132745 22043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:15.134269 22043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:15.135702 22043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:15.149495 22055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:15.149533 22058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:15.149410 22054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:15.150870 22043 server_base.cc:1034] running on GCE node
I20260812 11:17:15.151562 22043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:15.152792 22043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:15.154035 22043 hybrid_clock.cc:648] HybridClock initialized: now 1786533435153921 us; error 127 us; skew 500 ppm
I20260812 11:17:15.154413 22043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:15 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533435, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:15.158001 22043 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:15.159679 22043 webserver.cc:460] Webserver started at http://127.15.164.193:35185/ using document root <none> and password file <none>
I20260812 11:17:15.160426 22043 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:15.160578 22043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:15.160923 22043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:15.164028 22043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "6378f95a1cdf4a939f66264d192964a6"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "148a3765aa435685d68aa70b9f7dcc91"
server_key_iv: "44dbc9ef3135e11aa94ed6b6b23ace3e"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.164846 22043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "6378f95a1cdf4a939f66264d192964a6"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "148a3765aa435685d68aa70b9f7dcc91"
server_key_iv: "44dbc9ef3135e11aa94ed6b6b23ace3e"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.170588 22043 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 11:17:15.174420 22072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.176074 22043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:15.176288 22043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "6378f95a1cdf4a939f66264d192964a6"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "148a3765aa435685d68aa70b9f7dcc91"
server_key_iv: "44dbc9ef3135e11aa94ed6b6b23ace3e"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.176538 22043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:15.214744 22043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:15.219529 22043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:15.219870 22043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:15.220952 22043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:15.222388 22043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:15.222517 22043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.222673 22043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:15.222752 22043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.258287 22043 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:36665
I20260812 11:17:15.258338 22264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:36665 every 8 connection(s)
I20260812 11:17:15.259704 22043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:15.267040 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 22043
I20260812 11:17:15.267321 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:15.267979 16019 external_mini_cluster.cc:1428] Setting key 3ea01d4f80697caffca08d21b557e6bb
Aug 12 11:17:15 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533435, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:15.280308 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:15.262638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:45527 (local address 127.15.164.254:40075)
0812 11:17:15.263068 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:15.263073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:15.264045 (+ 972us) server_negotiation.cc:407] Connection header received
0812 11:17:15.265796 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:15.265800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:15.265867 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:15.265970 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:15.267640 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.268418 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.270281 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.270733 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.270867 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:15.274398 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:15.274403 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:15.274406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:15.274439 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:15.277220 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:15.277946 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:15.277953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:15.277956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:15.278084 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:15.278546 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:15.278553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:15.278561 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:15.278817 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:15.278976 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:15.279694 (+ 718us) server_negotiation.cc:299] Negotiation successful
0812 11:17:15.279927 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":214,"threads_started":1}
I20260812 11:17:15.281320 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:15.263178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40075 (local address 127.15.164.193:45527)
0812 11:17:15.263879 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:15.263917 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:15.265525 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:15.266167 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:15.266175 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:15.266797 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:15.267445 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:15.267485 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.268576 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.268581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:15.270115 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:15.270128 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.270979 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.270986 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:15.271212 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:15.271917 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:15.271940 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:15.274172 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:15.277358 (+ 3186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:15.277368 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:15.277385 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:15.277820 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:15.278198 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:15.278205 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:15.278209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:15.278398 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:15.278948 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:15.278956 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:15.279302 (+ 346us) client_negotiation.cc:769] Sending connection context
0812 11:17:15.279569 (+ 267us) client_negotiation.cc:240] Negotiation successful
0812 11:17:15.280145 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":274,"threads_started":1}
I20260812 11:17:15.282963 22268 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40075
I20260812 11:17:15.283355 22268 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:15.284355 22268 heartbeater.cc:511] Master 127.15.164.254:40075 requested a full tablet report, sending...
I20260812 11:17:15.286737 21949 ts_manager.cc:194] Registered new tserver with Master: 6378f95a1cdf4a939f66264d192964a6 (127.15.164.193:36665)
I20260812 11:17:15.288241 21949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:45527
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:15.323170 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:15.680783 22278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:15.681157 22278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:15.681259 22278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:15.689006 22278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:15.689137 22278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:15.689255 22278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:15.699717 22278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:15.701085 22278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:15.702435 22278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:15.716854 22288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:15.716881 22287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:15.716953 22291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:15.718039 22278 server_base.cc:1034] running on GCE node
I20260812 11:17:15.718891 22278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:15.720093 22278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:15.721379 22278 hybrid_clock.cc:648] HybridClock initialized: now 1786533435721336 us; error 64 us; skew 500 ppm
I20260812 11:17:15.721971 22278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:15 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533435, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:15.725710 22278 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:15.727524 22278 webserver.cc:460] Webserver started at http://127.15.164.194:35565/ using document root <none> and password file <none>
I20260812 11:17:15.728303 22278 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:15.728464 22278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:15.728961 22278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:15.732380 22278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "a4085e6007e14a9e867cf52286cda215"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "f360176907a868c4243e417bc93f0f8f"
server_key_iv: "96b039d9ed95041a8369d1a009bcc3c6"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.733546 22278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "a4085e6007e14a9e867cf52286cda215"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "f360176907a868c4243e417bc93f0f8f"
server_key_iv: "96b039d9ed95041a8369d1a009bcc3c6"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.739974 22278 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 11:17:15.744022 22305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.745617 22278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:15.745834 22278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "a4085e6007e14a9e867cf52286cda215"
format_stamp: "Formatted at 2026-08-12 11:17:15 on dist-test-slave-7kzw"
server_key: "f360176907a868c4243e417bc93f0f8f"
server_key_iv: "96b039d9ed95041a8369d1a009bcc3c6"
server_key_version: "encryptionkey@0"
I20260812 11:17:15.746146 22278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:15.762787 22278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:15.767624 22278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:15.767982 22278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:15.769059 22278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:15.770596 22278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:15.770717 22278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.770876 22278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:15.770968 22278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:15.811038 22278 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:40017
I20260812 11:17:15.811102 22509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:40017 every 8 connection(s)
I20260812 11:17:15.812450 22278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:15.817970 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 22278
I20260812 11:17:15.818198 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:15.818728 16019 external_mini_cluster.cc:1428] Setting key d94a3d432d8242ee0e146b51e31525a5
Aug 12 11:17:15 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533435, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:15.835479 22514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:15.815323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:56197 (local address 127.15.164.254:40075)
0812 11:17:15.815839 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:15.815844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:15.817219 (+ 1375us) server_negotiation.cc:407] Connection header received
0812 11:17:15.819666 (+ 2447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:15.819672 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:15.819769 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:15.819907 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:15.822004 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.822802 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.824476 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.824942 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.825096 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:15.829076 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:15.829082 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:15.829085 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:15.829124 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:15.831973 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:15.832842 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:15.832848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:15.832854 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:15.833002 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:15.833493 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:15.833499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:15.833502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:15.833810 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:15.833978 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:15.834812 (+ 834us) server_negotiation.cc:299] Negotiation successful
0812 11:17:15.835064 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":270,"threads_started":1}
I20260812 11:17:15.836568 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:15.815750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40075 (local address 127.15.164.194:56197)
0812 11:17:15.817038 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:15.817081 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:15.819171 (+ 2090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:15.820228 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:15.820268 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:15.821130 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:15.821796 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:15.821817 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.822983 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.822987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:15.824306 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:15.824320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:15.825205 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:15.825212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:15.825491 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:15.826272 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:15.826299 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:15.828782 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:15.832168 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:15.832180 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:15.832201 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:15.832698 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:15.833128 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:15.833134 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:15.833138 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:15.833365 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:15.833952 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:15.833961 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:15.834361 (+ 400us) client_negotiation.cc:769] Sending connection context
0812 11:17:15.834715 (+ 354us) client_negotiation.cc:240] Negotiation successful
0812 11:17:15.835332 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":552,"threads_started":1}
I20260812 11:17:15.838143 22512 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40075
I20260812 11:17:15.838581 22512 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:15.839432 22512 heartbeater.cc:511] Master 127.15.164.254:40075 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:17:15.841092 21949 ts_manager.cc:194] Registered new tserver with Master: a4085e6007e14a9e867cf52286cda215 (127.15.164.194:40017)
I20260812 11:17:15.842064 21949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:56197
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:15.874577 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:16.241466 22518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:16.241796 22518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:16.242002 22518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:16.249529 22518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:16.249707 22518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:16.249884 22518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:16.260411 22518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:16.261760 22518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:16.263231 22518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:16.280594 22532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:16.280606 22528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:16.280704 22527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:16.282686 22518 server_base.cc:1034] running on GCE node
I20260812 11:17:16.283440 22518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:16.284540 22518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:16.285801 22518 hybrid_clock.cc:648] HybridClock initialized: now 1786533436285741 us; error 65 us; skew 500 ppm
I20260812 11:17:16.286164 22518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:16.289924 22518 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:17:16.291918 22518 webserver.cc:460] Webserver started at http://127.15.164.195:45649/ using document root <none> and password file <none>
I20260812 11:17:16.292150 22268 heartbeater.cc:503] Master 127.15.164.254:40075 was elected leader, sending a full tablet report...
I20260812 11:17:16.292848 22518 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:16.292997 22518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:16.293354 22518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:16.296625 22518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "9cd898e4abe549c8adbca10841b3ee74"
format_stamp: "Formatted at 2026-08-12 11:17:16 on dist-test-slave-7kzw"
server_key: "b7293639e39309c504a3d25fbf9a6f02"
server_key_iv: "4ac5eb54f72e5b1d620f4fecab3cc1dc"
server_key_version: "encryptionkey@0"
I20260812 11:17:16.297508 22518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "9cd898e4abe549c8adbca10841b3ee74"
format_stamp: "Formatted at 2026-08-12 11:17:16 on dist-test-slave-7kzw"
server_key: "b7293639e39309c504a3d25fbf9a6f02"
server_key_iv: "4ac5eb54f72e5b1d620f4fecab3cc1dc"
server_key_version: "encryptionkey@0"
I20260812 11:17:16.303231 22518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:17:16.307240 22542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:16.308849 22518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:17:16.309062 22518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "9cd898e4abe549c8adbca10841b3ee74"
format_stamp: "Formatted at 2026-08-12 11:17:16 on dist-test-slave-7kzw"
server_key: "b7293639e39309c504a3d25fbf9a6f02"
server_key_iv: "4ac5eb54f72e5b1d620f4fecab3cc1dc"
server_key_version: "encryptionkey@0"
I20260812 11:17:16.309306 22518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:16.330871 22518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:16.335784 22518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:16.336189 22518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:16.337361 22518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:16.338953 22518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:16.339066 22518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:16.339223 22518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:16.339300 22518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:16.382745 22518 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:35865
I20260812 11:17:16.382776 22730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:35865 every 8 connection(s)
I20260812 11:17:16.384127 22518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:16.392582 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 22518
I20260812 11:17:16.392808 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:16.393388 16019 external_mini_cluster.cc:1428] Setting key 9d031c13c9b923ef2e89f87595b04528
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:16.410769 22736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.387949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40075 (local address 127.15.164.195:53195)
0812 11:17:16.388838 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:16.388883 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:16.390702 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:16.391482 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:16.391490 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:16.392237 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:16.393102 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:16.393129 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.395074 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.395079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:16.396626 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:16.396643 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.397783 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.397794 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:16.398146 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.399130 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:16.399156 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:16.401964 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:16.405440 (+ 3476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:16.405451 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:16.405469 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:16.406050 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:16.406445 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:16.406450 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:16.406454 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:16.406689 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:16.407341 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:16.407354 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:16.407947 (+ 593us) client_negotiation.cc:769] Sending connection context
0812 11:17:16.408324 (+ 377us) client_negotiation.cc:240] Negotiation successful
0812 11:17:16.409022 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":344,"threads_started":1}
I20260812 11:17:16.412452 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.387255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:53195 (local address 127.15.164.254:40075)
0812 11:17:16.387814 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.387819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.389018 (+ 1199us) server_negotiation.cc:407] Connection header received
0812 11:17:16.390983 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.390989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.391105 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.391241 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.393360 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.394865 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.396835 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.397391 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.397626 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.402236 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.402242 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.402245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.402281 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.405284 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.406181 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.406188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.406191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.406323 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.406819 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.406824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.406829 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.407121 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.407335 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.411608 (+ 4273us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.411923 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":284,"threads_started":1}
I20260812 11:17:16.413879 22731 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40075
I20260812 11:17:16.414286 22731 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:16.415371 22731 heartbeater.cc:511] Master 127.15.164.254:40075 requested a full tablet report, sending...
I20260812 11:17:16.417241 21949 ts_manager.cc:194] Registered new tserver with Master: 9cd898e4abe549c8adbca10841b3ee74 (127.15.164.195:35865)
I20260812 11:17:16.418530 21949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:53195
I20260812 11:17:16.422232 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:16.480440 22747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.463120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36230 (local address 127.15.164.193:36665)
0812 11:17:16.464051 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.464058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.464086 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:17:16.464154 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.464161 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.464388 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.464574 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.466097 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.467197 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.468472 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.469053 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.469203 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.474050 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.474063 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.474079 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.474117 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.477367 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.478112 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.478123 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.478126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.478270 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.478751 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.478758 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.478761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.479141 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.479522 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.479797 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.480093 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":553,"threads_started":1}
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:16.504168 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.485935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.15.164.254:40075)
0812 11:17:16.486166 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.486174 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.486329 (+ 155us) server_negotiation.cc:407] Connection header received
0812 11:17:16.486447 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.486455 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.486632 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.486756 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.487999 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.489351 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.490747 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.491550 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.491710 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.496162 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.496173 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.496181 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.496251 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.500701 (+ 4450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.501463 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.501472 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.501478 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.501671 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.502072 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.502080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.502086 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.502710 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.503037 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.503374 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.503691 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 11:17:16.504933 21949 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59170
I20260812 11:17:16.506108 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 22043
I20260812 11:17:16.520002 22747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.507123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36236 (local address 127.15.164.193:36665)
0812 11:17:16.507386 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.507393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.507670 (+ 277us) server_negotiation.cc:407] Connection header received
0812 11:17:16.507880 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.507885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.507975 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.508093 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.509331 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.510136 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.511684 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.512130 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.512280 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.514883 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.514888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.514891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.514925 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.517355 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.518016 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.518023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.518027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.518166 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.518583 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.518590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.518594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.518856 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.519118 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.519452 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.519680 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:17:16.520619 22257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:16.604844 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 22043
I20260812 11:17:16.635324 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 22278
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:17:16.653826 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.636389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60066 (local address 127.15.164.194:40017)
0812 11:17:16.637030 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.637037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.637067 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:17:16.637137 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.637144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.637375 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.637589 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.639002 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.640072 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.641468 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.642060 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.642229 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.647168 (+ 4939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.647184 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.647204 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.647243 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.650645 (+ 3402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.651495 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.651503 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.651505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.651645 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.652060 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.652066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.652069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.652458 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.652821 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.653154 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.653448 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":330,"threads_started":1}
I20260812 11:17:16.655592 22503 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:16.742931 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 22278
I20260812 11:17:16.771320 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 22518
Aug 12 11:17:16 dist-test-slave-7kzw krb5kdc[21877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:17:16.789919 22759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:16.772697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41160 (local address 127.15.164.195:35865)
0812 11:17:16.773443 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:16.773451 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:16.773482 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:17:16.773548 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:16.773555 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:16.773815 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:16.773953 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:16.775427 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.776654 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.777999 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:16.778831 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:16.778959 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:16.783768 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:16.783784 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:16.783801 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:16.783847 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:16.786977 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.787767 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.787776 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.787778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.787916 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:16.788271 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:16.788274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:16.788276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:16.788705 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:16.788954 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:16.789230 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 11:17:16.789496 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":390,"threads_started":1}
I20260812 11:17:16.791512 22723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:16.876915 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 22518
I20260812 11:17:16.904145 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 21899
I20260812 11:17:16.905572 21995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:17.013761 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 21899
2026-08-12T11:17:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4616 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:17 dist-test-slave-7kzw krb5kdc[22764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:17 dist-test-slave-7kzw krb5kdc[22764](info): set up 2 sockets
Aug 12 11:17:17 dist-test-slave-7kzw krb5kdc[22764](info): commencing operation
krb5kdc: starting...
W20260812 11:17:18.395838 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:18 dist-test-slave-7kzw krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:18.688284 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41179
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:19.070957 22782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:19.071355 22782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:19.071537 22782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:19.079454 22782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:19.079639 22782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:19.079775 22782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:19.079892 22782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:19.080024 22782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:19.090647 22782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:19.092155 22782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:19.093609 22782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:19.110790 22794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:19.110908 22788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:19.110908 22789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:19.111372 22782 server_base.cc:1034] running on GCE node
I20260812 11:17:19.112623 22782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:19.114390 22782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:19.115691 22782 hybrid_clock.cc:648] HybridClock initialized: now 1786533439115716 us; error 115 us; skew 500 ppm
I20260812 11:17:19.116128 22782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:19 dist-test-slave-7kzw krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:19.120042 22782 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:19.122083 22782 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:19.122196 22782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:19.122684 22782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:19.126143 22782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "9f8593c57b244ab488d58d02f341f52c"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "be951c7ffb46dcc2fe3abeb59199a42a"
server_key_iv: "4f944a6c28fda47858cab317ab0e9256"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.127220 22782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "9f8593c57b244ab488d58d02f341f52c"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "be951c7ffb46dcc2fe3abeb59199a42a"
server_key_iv: "4f944a6c28fda47858cab317ab0e9256"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.134130 22782 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:17:19.139168 22808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:19.140829 22782 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:17:19.141155 22782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "9f8593c57b244ab488d58d02f341f52c"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "be951c7ffb46dcc2fe3abeb59199a42a"
server_key_iv: "4f944a6c28fda47858cab317ab0e9256"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.141410 22782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:19.162264 22782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:19.168684 22782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:19.169028 22782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:19.193312 22782 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41179
I20260812 11:17:19.193333 22903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41179 every 8 connection(s)
I20260812 11:17:19.194430 22782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:19.199056 22904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:19.199061 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 22782
I20260812 11:17:19.199314 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:19.200168 16019 external_mini_cluster.cc:1428] Setting key 94bf3655d16cf6e8d410949fbbb38e00
I20260812 11:17:19.215780 22904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: Bootstrap starting.
Aug 12 11:17:19 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:19.220646 22904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:19.222193 22904 log.cc:824] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:19.226330 22904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: No bootstrap required, opened a new log
I20260812 11:17:19.230222 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:19.202704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38848 (local address 127.15.164.254:41179)
0812 11:17:19.203682 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:19.203699 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:19.203755 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:17:19.206055 (+ 2300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:19.206083 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:19.206642 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:19.207026 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:19.209278 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.210901 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.213148 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.214090 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.214270 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:19.219981 (+ 5711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:19.219994 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:19.220020 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:19.220085 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:19.224620 (+ 4535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:19.225606 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:19.225617 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:19.225630 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:19.225873 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:19.226533 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:19.226541 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:19.226545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:19.227340 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:19.227746 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:19.228360 (+ 614us) server_negotiation.cc:299] Negotiation successful
0812 11:17:19.228919 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":465,"threads_started":1}
I20260812 11:17:19.236299 22904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } }
I20260812 11:17:19.236807 22904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:19.236935 22904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f8593c57b244ab488d58d02f341f52c, State: Initialized, Role: FOLLOWER
I20260812 11:17:19.237736 22904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } }
I20260812 11:17:19.238026 22904 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:19.238188 22904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:19.238397 22904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:19.241163 22904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } }
I20260812 11:17:19.241832 22904 leader_election.cc:302] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f8593c57b244ab488d58d02f341f52c; no voters:
I20260812 11:17:19.242936 22904 leader_election.cc:288] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:19.243281 22915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:19.244377 22915 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [term 1 LEADER]: Becoming Leader. State: Replica: 9f8593c57b244ab488d58d02f341f52c, State: Running, Role: LEADER
I20260812 11:17:19.245059 22915 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } }
I20260812 11:17:19.245674 22904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:19.248497 22917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f8593c57b244ab488d58d02f341f52c. Latest consensus state: current_term: 1 leader_uuid: "9f8593c57b244ab488d58d02f341f52c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } } }
I20260812 11:17:19.249120 22917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:19.250142 22925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:19.248581 22916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f8593c57b244ab488d58d02f341f52c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8593c57b244ab488d58d02f341f52c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41179 } } }
I20260812 11:17:19.250797 22916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:19.255893 22925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:19.269539 22925 catalog_manager.cc:1347] Generated new cluster ID: 6825f245bfa24c29973d3b478cbae84a
I20260812 11:17:19.269893 22925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:19.289834 22925 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:19.291726 22925 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:19.308996 22925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: Generated new TSK 0
I20260812 11:17:19.310062 22925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:19.384049 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:19.776754 22949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:19.777096 22949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:19.777273 22949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:19.785729 22949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:19.785897 22949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:19.786145 22949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:19.798894 22949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:19.800545 22949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:19.802338 22949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:19.817677 22958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:19.817909 22960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:19.818164 22957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:19.818712 22949 server_base.cc:1034] running on GCE node
I20260812 11:17:19.819409 22949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:19.820619 22949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:19.821933 22949 hybrid_clock.cc:648] HybridClock initialized: now 1786533439821882 us; error 28 us; skew 500 ppm
I20260812 11:17:19.822901 22949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:19 dist-test-slave-7kzw krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:19.830703 22949 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:19.832322 22949 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:19.832444 22949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:19.832757 22949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:19.837208 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "edcc27b5b4ed15f3ce31d62c96ef6386"
server_key_iv: "d1688926bb2ccbaf05b0c776e2979409"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.838248 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "edcc27b5b4ed15f3ce31d62c96ef6386"
server_key_iv: "d1688926bb2ccbaf05b0c776e2979409"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.844794 22949 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:19.849488 22975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:19.851372 22949 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:17:19.851640 22949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1"
format_stamp: "Formatted at 2026-08-12 11:17:19 on dist-test-slave-7kzw"
server_key: "edcc27b5b4ed15f3ce31d62c96ef6386"
server_key_iv: "d1688926bb2ccbaf05b0c776e2979409"
server_key_version: "encryptionkey@0"
I20260812 11:17:19.851915 22949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:19.887385 22949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:19.892366 22949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:19.892699 22949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:19.893817 22949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:19.895463 22949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:19.895596 22949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:19.895745 22949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:19.895838 22949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:19.938043 22949 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:44413
I20260812 11:17:19.938088 23171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:44413 every 8 connection(s)
I20260812 11:17:19.939201 22949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:19.943188 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 22949
I20260812 11:17:19.943431 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:19.944227 16019 external_mini_cluster.cc:1428] Setting key c7e60d9f9ec73fd9e41bfc06bcc549ac
Aug 12 11:17:19 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:19.965514 23175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:19.941957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:42319 (local address 127.15.164.254:41179)
0812 11:17:19.942431 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:19.942438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:19.943856 (+ 1418us) server_negotiation.cc:407] Connection header received
0812 11:17:19.946423 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:19.946428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:19.946593 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:19.946803 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:19.948675 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.949451 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.951333 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.952256 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.952436 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:19.957865 (+ 5429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:19.957873 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:19.957877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:19.957925 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:19.960948 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:19.962335 (+ 1387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:19.962342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:19.962344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:19.962580 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:19.963302 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:19.963306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:19.963308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:19.963629 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:19.963816 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:19.964997 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0812 11:17:19.965226 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":219,"threads_started":1}
I20260812 11:17:19.967519 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:19.942594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41179 (local address 127.15.164.193:42319)
0812 11:17:19.943657 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:19.943714 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:19.946063 (+ 2349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:19.947103 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:19.947113 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:19.947772 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:19.948460 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:19.948483 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.949644 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.949648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:19.951112 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:19.951128 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:19.952657 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:19.952665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:19.953013 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:19.954414 (+ 1401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:19.954453 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:19.957497 (+ 3044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:19.961188 (+ 3691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:19.961206 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:19.961234 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:19.962130 (+ 896us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:19.962720 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:19.962730 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:19.962737 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:19.963128 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:19.963817 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:19.963831 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:19.964446 (+ 615us) client_negotiation.cc:769] Sending connection context
0812 11:17:19.964856 (+ 410us) client_negotiation.cc:240] Negotiation successful
0812 11:17:19.965623 (+ 767us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":403,"threads_started":1}
I20260812 11:17:19.969509 23172 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41179
I20260812 11:17:19.969915 23172 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:19.970809 23172 heartbeater.cc:511] Master 127.15.164.254:41179 requested a full tablet report, sending...
I20260812 11:17:19.973410 22841 ts_manager.cc:194] Registered new tserver with Master: b7e30c2d992d4ccb8fc41b16d05b8cd1 (127.15.164.193:44413)
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:17:19.975344 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:42319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:20.012442 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:20.397382 23182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:20.397807 23182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:20.397980 23182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:20.405685 23182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:20.405900 23182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:20.406112 23182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:20.418171 23182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:20.419907 23182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:20.421442 23182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:20.437244 23191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:20.437772 23192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:20.437984 23194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:20.444692 23182 server_base.cc:1034] running on GCE node
I20260812 11:17:20.445660 23182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:20.447052 23182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:20.448508 23182 hybrid_clock.cc:648] HybridClock initialized: now 1786533440448438 us; error 40 us; skew 500 ppm
I20260812 11:17:20.448921 23182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:20 dist-test-slave-7kzw krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533440, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:20.452994 23182 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:20.454646 23182 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:20.454766 23182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:20.455156 23182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:20.458963 23182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "ba1a14aa1ecb4128bcd42df922e898a2"
format_stamp: "Formatted at 2026-08-12 11:17:20 on dist-test-slave-7kzw"
server_key: "9077ce94029b93d92402fc78354c2084"
server_key_iv: "797acf0e2f261945a3877b92231c954a"
server_key_version: "encryptionkey@0"
I20260812 11:17:20.459931 23182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "ba1a14aa1ecb4128bcd42df922e898a2"
format_stamp: "Formatted at 2026-08-12 11:17:20 on dist-test-slave-7kzw"
server_key: "9077ce94029b93d92402fc78354c2084"
server_key_iv: "797acf0e2f261945a3877b92231c954a"
server_key_version: "encryptionkey@0"
I20260812 11:17:20.465689 23182 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:17:20.469744 23208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:20.471668 23182 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260812 11:17:20.471922 23182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "ba1a14aa1ecb4128bcd42df922e898a2"
format_stamp: "Formatted at 2026-08-12 11:17:20 on dist-test-slave-7kzw"
server_key: "9077ce94029b93d92402fc78354c2084"
server_key_iv: "797acf0e2f261945a3877b92231c954a"
server_key_version: "encryptionkey@0"
I20260812 11:17:20.472393 23182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:20.491230 23182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:20.495919 23182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:20.496270 23182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:20.497385 23182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:20.498960 23182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:20.499087 23182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:20.499221 23182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:20.499330 23182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:20.536998 23182 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:44477
I20260812 11:17:20.537038 23403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:44477 every 8 connection(s)
I20260812 11:17:20.537968 23182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:20.541904 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 23182
I20260812 11:17:20.542138 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:20.542774 16019 external_mini_cluster.cc:1428] Setting key ba5de4be28b1b9f30e28d6521f660aae
Aug 12 11:17:20 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533440, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:20.563943 23406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:20.540625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:43381 (local address 127.15.164.254:41179)
0812 11:17:20.541112 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:20.541120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:20.542284 (+ 1164us) server_negotiation.cc:407] Connection header received
0812 11:17:20.544761 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:20.544770 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:20.544869 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:20.544986 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:20.547134 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:20.548346 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:20.550053 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:20.550835 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:20.550993 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:20.555662 (+ 4669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:20.555669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:20.555672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:20.555715 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:20.559397 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:20.560781 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:20.560788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:20.560791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:20.561070 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:20.561774 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:20.561780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:20.561783 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:20.562130 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:20.562266 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:20.563432 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0812 11:17:20.563647 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":221,"threads_started":1}
I20260812 11:17:20.565653 23407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:20.541152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41179 (local address 127.15.164.194:43381)
0812 11:17:20.542098 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:20.542160 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:20.544376 (+ 2216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:20.545372 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:20.545382 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:20.546174 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:20.546927 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:20.546950 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:20.548558 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:20.548564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:20.549884 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:20.549898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:20.551178 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:20.551192 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:20.551505 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:20.552317 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:20.552350 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:20.555153 (+ 2803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:20.559618 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:20.559633 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:20.559660 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:20.560446 (+ 786us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:20.561260 (+ 814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:20.561268 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:20.561274 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:20.561568 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:20.562296 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:20.562309 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:20.562916 (+ 607us) client_negotiation.cc:769] Sending connection context
0812 11:17:20.563296 (+ 380us) client_negotiation.cc:240] Negotiation successful
0812 11:17:20.563962 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":359,"threads_started":1}
I20260812 11:17:20.567899 23404 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41179
I20260812 11:17:20.568312 23404 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:17:20.569305 23404 heartbeater.cc:511] Master 127.15.164.254:41179 requested a full tablet report, sending...
I20260812 11:17:20.571574 22841 ts_manager.cc:194] Registered new tserver with Master: ba1a14aa1ecb4128bcd42df922e898a2 (127.15.164.194:44477)
I20260812 11:17:20.572782 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:43381
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:20.608438 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:39129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:20.979681 23172 heartbeater.cc:503] Master 127.15.164.254:41179 was elected leader, sending a full tablet report...
W20260812 11:17:20.991644 23412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:20.992058 23412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:20.992245 23412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:21.000515 23412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:21.000710 23412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:21.000905 23412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:21.011497 23412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:21.013067 23412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:21.015048 23412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:21.031700 23423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:21.031687 23419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:21.032436 23418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:21.032584 23412 server_base.cc:1034] running on GCE node
I20260812 11:17:21.033344 23412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:21.034402 23412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:21.035730 23412 hybrid_clock.cc:648] HybridClock initialized: now 1786533441035647 us; error 61 us; skew 500 ppm
I20260812 11:17:21.036149 23412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:21 dist-test-slave-7kzw krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533441, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:21.040791 23412 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:17:21.042339 23412 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:21.042520 23412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:21.042907 23412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:21.046609 23412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "b49b74b75b5c450ea8a311d88497634f"
format_stamp: "Formatted at 2026-08-12 11:17:21 on dist-test-slave-7kzw"
server_key: "effedbcd59bfc39ee3f15e46cdbcebde"
server_key_iv: "2d6056dbd19e078dd7f5c6f33cc81d9d"
server_key_version: "encryptionkey@0"
I20260812 11:17:21.047592 23412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "b49b74b75b5c450ea8a311d88497634f"
format_stamp: "Formatted at 2026-08-12 11:17:21 on dist-test-slave-7kzw"
server_key: "effedbcd59bfc39ee3f15e46cdbcebde"
server_key_iv: "2d6056dbd19e078dd7f5c6f33cc81d9d"
server_key_version: "encryptionkey@0"
I20260812 11:17:21.053709 23412 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260812 11:17:21.057895 23433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:21.059537 23412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:17:21.059787 23412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "b49b74b75b5c450ea8a311d88497634f"
format_stamp: "Formatted at 2026-08-12 11:17:21 on dist-test-slave-7kzw"
server_key: "effedbcd59bfc39ee3f15e46cdbcebde"
server_key_iv: "2d6056dbd19e078dd7f5c6f33cc81d9d"
server_key_version: "encryptionkey@0"
I20260812 11:17:21.060046 23412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:21.084458 23412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:21.090212 23412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:21.090623 23412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:21.091841 23412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:21.093494 23412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:21.093600 23412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:21.093787 23412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:21.093873 23412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:21.140326 23412 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:40011
I20260812 11:17:21.140369 23624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:40011 every 8 connection(s)
I20260812 11:17:21.141302 23412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:21.148309 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 23412
I20260812 11:17:21.148573 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:21.149140 16019 external_mini_cluster.cc:1428] Setting key c5d4f1e77395e9b4c9db746ce796c1f4
Aug 12 11:17:21 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533441, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:21.168438 23631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.144551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:53055 (local address 127.15.164.254:41179)
0812 11:17:21.145199 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.145206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.146406 (+ 1200us) server_negotiation.cc:407] Connection header received
0812 11:17:21.148788 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.148793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.148893 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.149008 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:21.151360 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.152683 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.155005 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.155497 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.155616 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.160586 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:21.160593 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:21.160596 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:21.160640 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:21.164575 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.165597 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.165605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.165614 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.165788 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.166297 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.166304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.166312 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.166688 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:21.166875 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.167768 (+ 893us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.168022 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":283,"threads_started":1}
I20260812 11:17:21.169556 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.145140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41179 (local address 127.15.164.195:53055)
0812 11:17:21.146226 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.146270 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.148373 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.149352 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.149366 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.150180 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:21.151139 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.151172 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.153075 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.153084 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.154817 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.154832 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.155787 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.155794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.156041 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.156975 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:21.157006 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:21.160210 (+ 3204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:21.164787 (+ 4577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:21.164799 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:21.164826 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:21.165447 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:21.165921 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:21.165927 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:21.165931 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:21.166154 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:21.166838 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:21.166847 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:21.167289 (+ 442us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.167638 (+ 349us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.168288 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":470,"threads_started":1}
I20260812 11:17:21.171864 23627 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41179
I20260812 11:17:21.172308 23627 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:21.173143 23627 heartbeater.cc:511] Master 127.15.164.254:41179 requested a full tablet report, sending...
I20260812 11:17:21.175545 22841 ts_manager.cc:194] Registered new tserver with Master: b49b74b75b5c450ea8a311d88497634f (127.15.164.195:40011)
I20260812 11:17:21.177099 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:53055
I20260812 11:17:21.180614 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:17:21.204502 23631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.185812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38860 (local address 127.15.164.254:41179)
0812 11:17:21.186027 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.186032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.186735 (+ 703us) server_negotiation.cc:407] Connection header received
0812 11:17:21.186831 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.186835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.186921 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.187010 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:21.188994 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.189806 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.191543 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.192090 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.192210 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.195896 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:21.195904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:21.195907 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:21.195955 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:21.199930 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.201615 (+ 1685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.201622 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.201625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.201803 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.202579 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.202583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.202585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.203004 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:21.203227 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.203887 (+ 660us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.204124 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:17:21.211571 22841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:21.218899 22841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:21.258713 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.238453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:44477 (local address 127.0.0.1:42308)
0812 11:17:21.239304 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.239348 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.239579 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.244380 (+ 4801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.244394 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.244436 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:21.245007 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.245027 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.248041 (+ 3014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.248050 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.251581 (+ 3531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.251604 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.256237 (+ 4633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.256257 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.257147 (+ 890us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.257219 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.257387 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.257954 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":435,"threads_started":1}
I20260812 11:17:21.260136 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.238936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42308 (local address 127.15.164.194:44477)
0812 11:17:21.243021 (+ 4085us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.243031 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.243064 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:17:21.243189 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.243201 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.243519 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.243748 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:21.245337 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.247797 (+ 2460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.252000 (+ 4203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.254310 (+ 2310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.254707 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.255021 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.259274 (+ 4253us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.259715 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3886,"thread_start_us":12464,"threads_started":1}
I20260812 11:17:21.265482 23299 tablet_service.cc:1467] Processing CreateTablet for tablet bc255c92db7e48e3b035cae554f525ae (DEFAULT_TABLE table=test-table [id=2eea319f03574217a0f2aa2a1e813352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:21.267307 23299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc255c92db7e48e3b035cae554f525ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:21.269524 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.242985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40011 (local address 127.0.0.1:50014)
0812 11:17:21.254191 (+ 11206us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.254224 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.254418 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.257183 (+ 2765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.257188 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.257227 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:21.258090 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.258114 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.260977 (+ 2863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.260983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.266112 (+ 5129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.266131 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.268547 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.268565 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.268750 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.268797 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.268906 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.269065 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10977,"mutex_wait_us":44,"thread_start_us":14751,"threads_started":1}
I20260812 11:17:21.269706 23652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.243718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50014 (local address 127.15.164.195:40011)
0812 11:17:21.256075 (+ 12357us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.256087 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.256137 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:17:21.256292 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.256306 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.256690 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.257127 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:21.258583 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.260560 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.266349 (+ 5789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.268271 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.268545 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.268757 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.269017 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.269225 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11642,"thread_start_us":11906,"threads_started":1}
I20260812 11:17:21.271003 23653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.244541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.15.164.193:44413)
0812 11:17:21.255878 (+ 11337us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.255888 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.258421 (+ 2533us) server_negotiation.cc:407] Connection header received
0812 11:17:21.258571 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.258579 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.258828 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.259172 (+ 344us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:21.259817 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.261405 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.266596 (+ 5191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.268299 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.268539 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.268764 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.270342 (+ 1578us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.270611 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10887,"thread_start_us":10729,"threads_started":1}
I20260812 11:17:21.270174 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.243616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:44413 (local address 127.0.0.1:43348)
0812 11:17:21.258110 (+ 14494us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.258130 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.258286 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.259162 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.259167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.259194 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:21.259591 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.259604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.261561 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.261567 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.266342 (+ 4775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.266361 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.268995 (+ 2634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.269004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.269248 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.269289 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.269421 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.269596 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14350,"mutex_wait_us":24,"thread_start_us":10145,"threads_started":1}
I20260812 11:17:21.275266 23521 tablet_service.cc:1467] Processing CreateTablet for tablet bc255c92db7e48e3b035cae554f525ae (DEFAULT_TABLE table=test-table [id=2eea319f03574217a0f2aa2a1e813352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:21.275758 23068 tablet_service.cc:1467] Processing CreateTablet for tablet bc255c92db7e48e3b035cae554f525ae (DEFAULT_TABLE table=test-table [id=2eea319f03574217a0f2aa2a1e813352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:21.277786 23521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc255c92db7e48e3b035cae554f525ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:21.278357 23068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc255c92db7e48e3b035cae554f525ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:21.282824 23654 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Bootstrap starting.
I20260812 11:17:21.287173 23654 tablet_bootstrap.cc:654] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:21.288390 23654 log.cc:824] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:21.296166 23656 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Bootstrap starting.
I20260812 11:17:21.297953 23654 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: No bootstrap required, opened a new log
I20260812 11:17:21.298298 23654 ts_tablet_manager.cc:1397] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20260812 11:17:21.299254 23657 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Bootstrap starting.
I20260812 11:17:21.300966 23656 tablet_bootstrap.cc:654] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:21.302861 23656 log.cc:824] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:21.303201 23657 tablet_bootstrap.cc:654] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:21.304409 23657 log.cc:824] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:21.306799 23656 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: No bootstrap required, opened a new log
I20260812 11:17:21.307181 23656 ts_tablet_manager.cc:1397] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260812 11:17:21.308594 23657 tablet_bootstrap.cc:492] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: No bootstrap required, opened a new log
I20260812 11:17:21.308898 23657 ts_tablet_manager.cc:1397] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 11:17:21.309158 23654 raft_consensus.cc:348] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.309698 23654 raft_consensus.cc:374] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:21.309855 23654 raft_consensus.cc:729] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1a14aa1ecb4128bcd42df922e898a2, State: Initialized, Role: FOLLOWER
I20260812 11:17:21.310634 23654 consensus_queue.cc:260] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.312139 23404 heartbeater.cc:503] Master 127.15.164.254:41179 was elected leader, sending a full tablet report...
I20260812 11:17:21.312775 23654 ts_tablet_manager.cc:1428] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260812 11:17:21.320556 23657 raft_consensus.cc:348] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.321033 23657 raft_consensus.cc:374] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:21.321192 23657 raft_consensus.cc:729] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e30c2d992d4ccb8fc41b16d05b8cd1, State: Initialized, Role: FOLLOWER
I20260812 11:17:21.322088 23657 consensus_queue.cc:260] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.323637 23656 raft_consensus.cc:348] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.324054 23657 ts_tablet_manager.cc:1428] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260812 11:17:21.324249 23656 raft_consensus.cc:374] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:21.324384 23656 raft_consensus.cc:729] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49b74b75b5c450ea8a311d88497634f, State: Initialized, Role: FOLLOWER
I20260812 11:17:21.325090 23656 consensus_queue.cc:260] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.326424 23627 heartbeater.cc:503] Master 127.15.164.254:41179 was elected leader, sending a full tablet report...
I20260812 11:17:21.327092 23656 ts_tablet_manager.cc:1428] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Time spent starting tablet: real 0.020s user 0.016s sys 0.001s
W20260812 11:17:21.393674 23629 tablet.cc:2369] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:17:21.442440 23174 tablet.cc:2369] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:21.466533 23661 raft_consensus.cc:482] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:21.466997 23661 raft_consensus.cc:504] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.468953 23661 leader_election.cc:288] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49b74b75b5c450ea8a311d88497634f (127.15.164.195:40011), b7e30c2d992d4ccb8fc41b16d05b8cd1 (127.15.164.193:44413)
I20260812 11:17:21.480389 23653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.469706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:47661 (local address 127.15.164.193:44413)
0812 11:17:21.469948 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.469956 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.470914 (+ 958us) server_negotiation.cc:407] Connection header received
0812 11:17:21.471211 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.471218 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.471316 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.471452 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:21.472669 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.473962 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.477805 (+ 3843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.479129 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.479329 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.479413 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.479967 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.480122 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:17:21.480388 23652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.469702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:47369 (local address 127.15.164.195:40011)
0812 11:17:21.469948 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.469956 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.470989 (+ 1033us) server_negotiation.cc:407] Connection header received
0812 11:17:21.471225 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.471231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.471316 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.471452 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:21.472669 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.473961 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.477805 (+ 3844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.479140 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.479329 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.479413 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.479967 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.480115 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:17:21.480772 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.469502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:44413 (local address 127.15.164.194:47661)
0812 11:17:21.470777 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.470800 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.471009 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.471507 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.471513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.471638 (+ 125us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:21.472420 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.472436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.474171 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.474178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.477538 (+ 3360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.477558 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.479455 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.479463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.479726 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.479783 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.479894 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.480088 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1143,"mutex_wait_us":235,"spinlock_wait_cycles":38272,"thread_start_us":715,"threads_started":1}
I20260812 11:17:21.480798 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.469315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40011 (local address 127.15.164.194:47369)
0812 11:17:21.470777 (+ 1462us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:21.470808 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:21.471009 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:21.471507 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:21.471513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:21.471624 (+ 111us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:21.472419 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.472436 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.474171 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.474178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.477538 (+ 3360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:21.477558 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.479461 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.479466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:21.479777 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.479803 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:17:21.479894 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:17:21.480088 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1257,"mutex_wait_us":372,"spinlock_wait_cycles":20224,"thread_start_us":898,"threads_started":1}
I20260812 11:17:21.482261 23100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc255c92db7e48e3b035cae554f525ae" candidate_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" is_pre_election: true
I20260812 11:17:21.482262 23559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc255c92db7e48e3b035cae554f525ae" candidate_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49b74b75b5c450ea8a311d88497634f" is_pre_election: true
I20260812 11:17:21.483018 23100 raft_consensus.cc:2454] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1a14aa1ecb4128bcd42df922e898a2 in term 0.
I20260812 11:17:21.483158 23559 raft_consensus.cc:2454] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba1a14aa1ecb4128bcd42df922e898a2 in term 0.
I20260812 11:17:21.483911 23212 leader_election.cc:302] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b49b74b75b5c450ea8a311d88497634f, ba1a14aa1ecb4128bcd42df922e898a2; no voters:
I20260812 11:17:21.484347 23661 raft_consensus.cc:2781] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:21.484542 23661 raft_consensus.cc:482] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:21.484663 23661 raft_consensus.cc:3037] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:21.487432 23661 raft_consensus.cc:504] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.488312 23661 leader_election.cc:288] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [CANDIDATE]: Term 1 election: Requested vote from peers b49b74b75b5c450ea8a311d88497634f (127.15.164.195:40011), b7e30c2d992d4ccb8fc41b16d05b8cd1 (127.15.164.193:44413)
I20260812 11:17:21.488948 23559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc255c92db7e48e3b035cae554f525ae" candidate_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49b74b75b5c450ea8a311d88497634f"
I20260812 11:17:21.489069 23100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc255c92db7e48e3b035cae554f525ae" candidate_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1"
I20260812 11:17:21.489245 23559 raft_consensus.cc:3037] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:21.489423 23100 raft_consensus.cc:3037] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:21.491767 23559 raft_consensus.cc:2454] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1a14aa1ecb4128bcd42df922e898a2 in term 1.
I20260812 11:17:21.491935 23100 raft_consensus.cc:2454] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba1a14aa1ecb4128bcd42df922e898a2 in term 1.
I20260812 11:17:21.492352 23212 leader_election.cc:302] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b49b74b75b5c450ea8a311d88497634f, ba1a14aa1ecb4128bcd42df922e898a2; no voters:
I20260812 11:17:21.492745 23661 raft_consensus.cc:2781] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:21.493654 23661 raft_consensus.cc:686] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 1 LEADER]: Becoming Leader. State: Replica: ba1a14aa1ecb4128bcd42df922e898a2, State: Running, Role: LEADER
I20260812 11:17:21.494549 23661 consensus_queue.cc:237] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } }
I20260812 11:17:21.501544 22839 catalog_manager.cc:5495] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba1a14aa1ecb4128bcd42df922e898a2 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba1a14aa1ecb4128bcd42df922e898a2" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260812 11:17:21.540278 23405 tablet.cc:2369] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:21.571076 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.565122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42324 (local address 127.15.164.194:44477)
0812 11:17:21.565324 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.565329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.565348 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:17:21.565534 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.565538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.565631 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.565804 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:21.566123 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.566965 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.568461 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.568865 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.568965 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.569588 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:21.570168 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:21.570295 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.570595 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.570754 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:17:21.582149 23559 raft_consensus.cc:1261] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 1 FOLLOWER]: Refusing update from remote peer ba1a14aa1ecb4128bcd42df922e898a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:21.582433 23100 raft_consensus.cc:1261] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 1 FOLLOWER]: Refusing update from remote peer ba1a14aa1ecb4128bcd42df922e898a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:21.584128 23667 consensus_queue.cc:1035] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7e30c2d992d4ccb8fc41b16d05b8cd1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:21.584719 23661 consensus_queue.cc:1035] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49b74b75b5c450ea8a311d88497634f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:21.620654 22841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:21.621022 22841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:21.625610 22841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f8593c57b244ab488d58d02f341f52c: Sending DeleteTablet for 3 replicas of tablet bc255c92db7e48e3b035cae554f525ae
I20260812 11:17:21.627206 23299 tablet_service.cc:1514] Processing DeleteTablet for tablet bc255c92db7e48e3b035cae554f525ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:21 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:42308
I20260812 11:17:21.627241 23521 tablet_service.cc:1514] Processing DeleteTablet for tablet bc255c92db7e48e3b035cae554f525ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:21 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:50014
I20260812 11:17:21.628000 23068 tablet_service.cc:1514] Processing DeleteTablet for tablet bc255c92db7e48e3b035cae554f525ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:21 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:43348
I20260812 11:17:21.632607 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 22949
I20260812 11:17:21.640363 23696 tablet_replica.cc:330] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: stopping tablet replica
I20260812 11:17:21.641469 23696 raft_consensus.cc:2229] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:21.642879 23696 raft_consensus.cc:2258] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:21.643771 23695 tablet_replica.cc:330] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: stopping tablet replica
I20260812 11:17:21.644800 23695 raft_consensus.cc:2229] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:21.645306 23699 tablet_replica.cc:330] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: stopping tablet replica
I20260812 11:17:21.645766 23695 raft_consensus.cc:2258] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:21.645848 23699 raft_consensus.cc:2229] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:21.646576 23699 raft_consensus.cc:2258] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:21.647425 23696 ts_tablet_manager.cc:1905] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:21.648550 23695 ts_tablet_manager.cc:1905] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:21.652658 23699 ts_tablet_manager.cc:1905] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:21.657076 23695 ts_tablet_manager.cc:1918] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:21.657094 23696 ts_tablet_manager.cc:1918] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:21.657281 23696 log.cc:1196] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/bc255c92db7e48e3b035cae554f525ae
I20260812 11:17:21.657445 23695 log.cc:1196] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/bc255c92db7e48e3b035cae554f525ae
I20260812 11:17:21.658164 23696 ts_tablet_manager.cc:1939] T bc255c92db7e48e3b035cae554f525ae P ba1a14aa1ecb4128bcd42df922e898a2: Deleting consensus metadata
I20260812 11:17:21.658489 23695 ts_tablet_manager.cc:1939] T bc255c92db7e48e3b035cae554f525ae P b49b74b75b5c450ea8a311d88497634f: Deleting consensus metadata
I20260812 11:17:21.660542 22820 catalog_manager.cc:4841] TS ba1a14aa1ecb4128bcd42df922e898a2 (127.15.164.194:44477): tablet bc255c92db7e48e3b035cae554f525ae (table test-table [id=2eea319f03574217a0f2aa2a1e813352]) successfully deleted
I20260812 11:17:21.660940 22820 catalog_manager.cc:4841] TS b49b74b75b5c450ea8a311d88497634f (127.15.164.195:40011): tablet bc255c92db7e48e3b035cae554f525ae (table test-table [id=2eea319f03574217a0f2aa2a1e813352]) successfully deleted
I20260812 11:17:21.662878 23699 ts_tablet_manager.cc:1918] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 12 11:17:21 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:21.663363 23699 log.cc:1196] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/bc255c92db7e48e3b035cae554f525ae
I20260812 11:17:21.664511 23699 ts_tablet_manager.cc:1939] T bc255c92db7e48e3b035cae554f525ae P b7e30c2d992d4ccb8fc41b16d05b8cd1: Deleting consensus metadata
I20260812 11:17:21.668373 22812 catalog_manager.cc:4841] TS b7e30c2d992d4ccb8fc41b16d05b8cd1 (127.15.164.193:44413): tablet bc255c92db7e48e3b035cae554f525ae (table test-table [id=2eea319f03574217a0f2aa2a1e813352]) successfully deleted
I20260812 11:17:21.675318 23653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.634556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.15.164.193:44413)
0812 11:17:21.634850 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.634860 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.644115 (+ 9255us) server_negotiation.cc:407] Connection header received
0812 11:17:21.644639 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.644654 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.644870 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.645029 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:21.647994 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.649257 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.652904 (+ 3647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.653654 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.653791 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.665173 (+ 11382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:21.665193 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:21.665217 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:21.665279 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:21.670886 (+ 5607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.672033 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.672047 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.672051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.672278 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.672792 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.672799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.672803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.673394 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:21.673819 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.674422 (+ 603us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.674805 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 11:17:21.676239 23165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:21.778347 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 22949
I20260812 11:17:21.812925 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 23182
Aug 12 11:17:21 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:17:21.833827 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.813964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.15.164.194:44477)
0812 11:17:21.814155 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.814160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.814184 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:17:21.814429 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.814433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.814566 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.814673 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:21.816532 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.817574 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.819776 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.820296 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.820604 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.826639 (+ 6035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:21.826658 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:21.826677 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:21.826729 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:21.830303 (+ 3574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.831361 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.831370 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.831372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.831539 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:21.832027 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:21.832032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:21.832034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:21.832464 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:21.832800 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:21.833154 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 11:17:21.833361 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:17:21.834805 23399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:21.953313 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 23182
I20260812 11:17:21.986706 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 23412
Aug 12 11:17:21 dist-test-slave-7kzw krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:17:22.004575 23706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:21.987772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50026 (local address 127.15.164.195:40011)
0812 11:17:21.988317 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:21.988322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:21.988342 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:21.988405 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:21.988409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:21.988477 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:21.988597 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:21.989963 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.990908 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.992429 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:21.992856 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:21.992964 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:21.998446 (+ 5482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:21.998535 (+ 89us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:21.998565 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:21.998614 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:22.001665 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:22.002442 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:22.002451 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:22.002454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:22.002693 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:22.003132 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:22.003135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:22.003138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:22.003527 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:22.003770 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:22.004091 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 11:17:22.004267 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":316,"threads_started":1}
I20260812 11:17:22.005330 23620 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:22.100418 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 23412
I20260812 11:17:22.126551 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 22782
I20260812 11:17:22.127728 22894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:22.241940 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 22782
2026-08-12T11:17:22Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5232 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T11:17:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:22Z Disabled control of system clock
I20260812 11:17:22.335345 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41879
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:17:22.691322 23715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:22.691677 23715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:22.691768 23715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:22.699450 23715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:22.699577 23715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:22.699617 23715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:22.699669 23715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:22.699714 23715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:22.709617 23715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41879
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:22.711108 23715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:22.713001 23715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:22.726266 23727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:22.726432 23730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:22.726238 23726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:22.727120 23715 server_base.cc:1034] running on GCE node
I20260812 11:17:22.728012 23715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:22.729576 23715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:22.730803 23715 hybrid_clock.cc:648] HybridClock initialized: now 1786533442730762 us; error 33 us; skew 500 ppm
I20260812 11:17:22.731215 23715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:22.733810 23715 webserver.cc:460] Webserver started at http://127.15.164.254:39601/ using document root <none> and password file <none>
I20260812 11:17:22.734647 23715 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:22.734776 23715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:22.735159 23715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:22.738188 23715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "7df3a6636a48445ba8c0a8d075a83c24"
format_stamp: "Formatted at 2026-08-12 11:17:22 on dist-test-slave-7kzw"
server_key: "1f64a0e57593bca7958404a640b92329"
server_key_iv: "ed8a0e42c4b1e2f91ef411aab486f826"
server_key_version: "encryptionkey@0"
I20260812 11:17:22.739111 23715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "7df3a6636a48445ba8c0a8d075a83c24"
format_stamp: "Formatted at 2026-08-12 11:17:22 on dist-test-slave-7kzw"
server_key: "1f64a0e57593bca7958404a640b92329"
server_key_iv: "ed8a0e42c4b1e2f91ef411aab486f826"
server_key_version: "encryptionkey@0"
I20260812 11:17:22.745204 23715 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:22.749356 23740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:22.751276 23715 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260812 11:17:22.751474 23715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "7df3a6636a48445ba8c0a8d075a83c24"
format_stamp: "Formatted at 2026-08-12 11:17:22 on dist-test-slave-7kzw"
server_key: "1f64a0e57593bca7958404a640b92329"
server_key_iv: "ed8a0e42c4b1e2f91ef411aab486f826"
server_key_version: "encryptionkey@0"
I20260812 11:17:22.751711 23715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:22.758785 23715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:22.759748 23715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:22.760092 23715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:22.780788 23715 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41879
I20260812 11:17:22.780833 23819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41879 every 8 connection(s)
I20260812 11:17:22.782296 23715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:22.786628 23821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:22.790679 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 23715
I20260812 11:17:22.790895 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:22.791787 16019 external_mini_cluster.cc:1428] Setting key 354e8acf5fb9968dbfae2e8c6a930903
I20260812 11:17:22.801899 23821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: Bootstrap starting.
I20260812 11:17:22.803372 23824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:22.795112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44842 (local address 127.15.164.254:41879)
0812 11:17:22.796315 (+ 1203us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:22.796326 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:22.796380 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:17:22.798960 (+ 2580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:22.798989 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:22.799491 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:22.799942 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:22.801235 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:22.801242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:22.801256 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:22.801278 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:22.801342 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:22.801358 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:22.801541 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:22.801956 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 11:17:22.802274 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":441,"threads_started":1}
I20260812 11:17:22.805716 23821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:22.807025 23821 log.cc:824] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:22.809959 23821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: No bootstrap required, opened a new log
I20260812 11:17:22.817551 23821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } }
I20260812 11:17:22.817986 23821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:22.818099 23821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7df3a6636a48445ba8c0a8d075a83c24, State: Initialized, Role: FOLLOWER
I20260812 11:17:22.818810 23821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } }
I20260812 11:17:22.819082 23821 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:22.819242 23821 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:22.819453 23821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:22.821759 23821 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } }
I20260812 11:17:22.822232 23821 leader_election.cc:302] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7df3a6636a48445ba8c0a8d075a83c24; no voters:
I20260812 11:17:22.822916 23821 leader_election.cc:288] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:22.823123 23826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:22.824267 23826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [term 1 LEADER]: Becoming Leader. State: Replica: 7df3a6636a48445ba8c0a8d075a83c24, State: Running, Role: LEADER
I20260812 11:17:22.824848 23826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } }
I20260812 11:17:22.825287 23821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:22.827737 23831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7df3a6636a48445ba8c0a8d075a83c24. Latest consensus state: current_term: 1 leader_uuid: "7df3a6636a48445ba8c0a8d075a83c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } } }
I20260812 11:17:22.828112 23831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:22.828902 23830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7df3a6636a48445ba8c0a8d075a83c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df3a6636a48445ba8c0a8d075a83c24" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41879 } } }
I20260812 11:17:22.829161 23835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:22.830533 23830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:22.836691 23835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:22.848143 23835 catalog_manager.cc:1347] Generated new cluster ID: 33b62faa463c4d6ebb1e650932b4c354
I20260812 11:17:22.848284 23835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:22.861830 23835 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:22.862293 23835 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:22.881923 23835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: Generated new TSK 0
I20260812 11:17:22.882975 23835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:17:22.893097 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--builtin_ntp_servers=127.15.164.212:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:17:23.284119 23852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:23.284409 23852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:23.284502 23852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:23.291790 23852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:23.291918 23852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:23.292033 23852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:23.301833 23852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:23.303380 23852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:23.305367 23852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:23.320143 23868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:23.320225 23860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:23.320225 23861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:23.321277 23852 server_base.cc:1034] running on GCE node
I20260812 11:17:23.322000 23852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:23.323133 23852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:23.324393 23852 hybrid_clock.cc:648] HybridClock initialized: now 1786533443324354 us; error 31 us; skew 500 ppm
I20260812 11:17:23.324786 23852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:23.327666 23852 webserver.cc:460] Webserver started at http://127.15.164.193:41911/ using document root <none> and password file <none>
I20260812 11:17:23.328437 23852 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:23.328583 23852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:23.328955 23852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:23.332137 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "15a16adf71bc4c2896a888528daa0339"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "b2652eaf7842e0bd5bb6bae455809e7a"
server_key_iv: "b718a42c574dc35cf38d6f677fab47b0"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.333036 23852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "15a16adf71bc4c2896a888528daa0339"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "b2652eaf7842e0bd5bb6bae455809e7a"
server_key_iv: "b718a42c574dc35cf38d6f677fab47b0"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.339121 23852 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:17:23.343346 23877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.344915 23852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:23.345152 23852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "15a16adf71bc4c2896a888528daa0339"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "b2652eaf7842e0bd5bb6bae455809e7a"
server_key_iv: "b718a42c574dc35cf38d6f677fab47b0"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.345424 23852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:23.351687 23852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:23.352591 23852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:23.352911 23852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:23.353979 23852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:23.355780 23852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:23.355903 23852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.356047 23852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:23.356138 23852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.393641 23852 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:37871
I20260812 11:17:23.393698 24074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:37871 every 8 connection(s)
I20260812 11:17:23.395299 23852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:23.404572 24077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:23.398274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:47759 (local address 127.15.164.254:41879)
0812 11:17:23.398910 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:23.398915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:23.400232 (+ 1317us) server_negotiation.cc:407] Connection header received
0812 11:17:23.402015 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:23.402021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:23.402101 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:23.402235 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:23.403677 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:23.403684 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:23.403690 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:23.403714 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:23.403767 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:23.403783 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:23.403931 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:23.404132 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 11:17:23.404212 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":341,"threads_started":1}
I20260812 11:17:23.404960 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 23852
I20260812 11:17:23.405181 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:23.405649 24082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:23.399003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41879 (local address 127.15.164.193:47759)
0812 11:17:23.400020 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:23.400068 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:23.401713 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:23.402549 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:23.402557 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:23.402656 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:23.403362 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:23.403364 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:23.403406 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:23.403498 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:23.403890 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:23.403903 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:23.403913 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:17:23.404229 (+ 316us) client_negotiation.cc:240] Negotiation successful
0812 11:17:23.404501 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":296,"threads_started":1}
I20260812 11:17:23.405956 16019 external_mini_cluster.cc:1428] Setting key 984f04855268ca97719c90ce7faab450
I20260812 11:17:23.407534 24075 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41879
I20260812 11:17:23.408181 24075 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:23.409116 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--builtin_ntp_servers=127.15.164.212:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:17:23.409132 24075 heartbeater.cc:511] Master 127.15.164.254:41879 requested a full tablet report, sending...
I20260812 11:17:23.412186 23762 ts_manager.cc:194] Registered new tserver with Master: 15a16adf71bc4c2896a888528daa0339 (127.15.164.193:37871)
W20260812 11:17:23.779306 24083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:23.779666 24083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:23.779769 24083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:23.791603 24083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:23.791757 24083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:23.791932 24083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:23.808116 24083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:23.809659 24083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:23.811877 24083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:23.827824 24093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:23.827793 24091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:23.827975 24095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:23.828874 24083 server_base.cc:1034] running on GCE node
I20260812 11:17:23.829617 24083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:23.830825 24083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:23.832178 24083 hybrid_clock.cc:648] HybridClock initialized: now 1786533443832122 us; error 75 us; skew 500 ppm
I20260812 11:17:23.832576 24083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:23.835325 24083 webserver.cc:460] Webserver started at http://127.15.164.194:39253/ using document root <none> and password file <none>
I20260812 11:17:23.836169 24083 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:23.836315 24083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:23.836702 24083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:23.839999 24083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "629ab11d3c4049b0b060a45719c63f1a"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "401df18e1134598a4a9c37c27a6ac8a1"
server_key_iv: "2dc7d6d246564a790417b3db7762c709"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.840909 24083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "629ab11d3c4049b0b060a45719c63f1a"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "401df18e1134598a4a9c37c27a6ac8a1"
server_key_iv: "2dc7d6d246564a790417b3db7762c709"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.847280 24083 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 11:17:23.851605 24105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.853262 24083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:23.853493 24083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "629ab11d3c4049b0b060a45719c63f1a"
format_stamp: "Formatted at 2026-08-12 11:17:23 on dist-test-slave-7kzw"
server_key: "401df18e1134598a4a9c37c27a6ac8a1"
server_key_iv: "2dc7d6d246564a790417b3db7762c709"
server_key_version: "encryptionkey@0"
I20260812 11:17:23.853777 24083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:23.861040 24083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:23.861954 24083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:23.862279 24083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:23.863379 24083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:23.864977 24083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:23.865109 24083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.865253 24083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:23.865348 24083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:23.902716 24083 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46679
I20260812 11:17:23.902875 24304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46679 every 8 connection(s)
I20260812 11:17:23.904207 24083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:23.907829 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 24083
I20260812 11:17:23.908242 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:23.908972 16019 external_mini_cluster.cc:1428] Setting key 6a37dba43b1e73a060b61de85040e28b
I20260812 11:17:23.912463 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--builtin_ntp_servers=127.15.164.212:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:17:23.915060 24310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:23.907413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:55073 (local address 127.15.164.254:41879)
0812 11:17:23.908281 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:23.908290 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:23.909436 (+ 1146us) server_negotiation.cc:407] Connection header received
0812 11:17:23.911817 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:23.911823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:23.911919 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:23.912075 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:23.913941 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:23.913947 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:23.913951 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:23.913973 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:23.914038 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:23.914053 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:23.914177 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:23.914634 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:17:23.914718 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":558,"threads_started":1}
I20260812 11:17:23.916342 24312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:23.907959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41879 (local address 127.15.164.194:55073)
0812 11:17:23.909252 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:23.909302 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:23.911314 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:23.912430 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:23.912446 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:23.912643 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:23.913483 (+ 840us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:23.913489 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:23.913551 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:23.913687 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:23.914184 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:23.914199 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:23.914212 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 11:17:23.914564 (+ 352us) client_negotiation.cc:240] Negotiation successful
0812 11:17:23.914912 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":410,"threads_started":1}
I20260812 11:17:23.918078 24305 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41879
I20260812 11:17:23.918859 24305 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:23.919996 24305 heartbeater.cc:511] Master 127.15.164.254:41879 requested a full tablet report, sending...
I20260812 11:17:23.921842 23762 ts_manager.cc:194] Registered new tserver with Master: 629ab11d3c4049b0b060a45719c63f1a (127.15.164.194:46679)
W20260812 11:17:24.287601 24314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:24.287909 24314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:24.288002 24314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:24.295423 24314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:24.295542 24314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:24.295651 24314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:24.304997 24314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:24.306303 24314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:24.308185 24314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:24.322108 24325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:24.322165 24329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:24.322203 24323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:24.322853 24314 server_base.cc:1034] running on GCE node
I20260812 11:17:24.323657 24314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:24.324612 24314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:24.325835 24314 hybrid_clock.cc:648] HybridClock initialized: now 1786533444325812 us; error 70 us; skew 500 ppm
I20260812 11:17:24.326216 24314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:24.328814 24314 webserver.cc:460] Webserver started at http://127.15.164.195:41927/ using document root <none> and password file <none>
I20260812 11:17:24.329553 24314 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:24.329700 24314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:24.330049 24314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:24.333361 24314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "1761f348e6414e0e9f281746f68a303a"
format_stamp: "Formatted at 2026-08-12 11:17:24 on dist-test-slave-7kzw"
server_key: "aac8df3f00e0ec747542a0c69badefd0"
server_key_iv: "b4d56f2d6029734183ad781c5bbffc64"
server_key_version: "encryptionkey@0"
I20260812 11:17:24.334177 24314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "1761f348e6414e0e9f281746f68a303a"
format_stamp: "Formatted at 2026-08-12 11:17:24 on dist-test-slave-7kzw"
server_key: "aac8df3f00e0ec747542a0c69badefd0"
server_key_iv: "b4d56f2d6029734183ad781c5bbffc64"
server_key_version: "encryptionkey@0"
I20260812 11:17:24.339535 24314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260812 11:17:24.343307 24337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:24.344697 24314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:17:24.344898 24314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "1761f348e6414e0e9f281746f68a303a"
format_stamp: "Formatted at 2026-08-12 11:17:24 on dist-test-slave-7kzw"
server_key: "aac8df3f00e0ec747542a0c69badefd0"
server_key_iv: "b4d56f2d6029734183ad781c5bbffc64"
server_key_version: "encryptionkey@0"
I20260812 11:17:24.345127 24314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:24.351975 24314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:24.352859 24314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:24.353159 24314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:24.354153 24314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:24.355907 24314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:24.356043 24314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:24.356194 24314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:24.356287 24314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:24.394841 24314 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:40611
I20260812 11:17:24.394872 24525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:40611 every 8 connection(s)
I20260812 11:17:24.396739 24314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:24.402938 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 24314
I20260812 11:17:24.403123 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:24.403906 16019 external_mini_cluster.cc:1428] Setting key 80e2f5152acac65e5f688aecb187c5fa
I20260812 11:17:24.406874 24310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.400415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:47419 (local address 127.15.164.254:41879)
0812 11:17:24.400635 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.400640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.402162 (+ 1522us) server_negotiation.cc:407] Connection header received
0812 11:17:24.404206 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.404212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.404302 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.404429 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.405910 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.405917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.405922 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.405944 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.405993 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.406008 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.406144 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.406416 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.406516 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:17:24.407863 24532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.400923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41879 (local address 127.15.164.195:47419)
0812 11:17:24.401974 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.402022 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.403859 (+ 1837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.404691 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.404701 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.404803 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.405575 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.405578 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.405623 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.405720 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.406132 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.406144 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.406155 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.406535 (+ 380us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.406796 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":328,"threads_started":1}
I20260812 11:17:24.409761 24529 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41879
I20260812 11:17:24.410071 24529 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:24.410794 24529 heartbeater.cc:511] Master 127.15.164.254:41879 requested a full tablet report, sending...
I20260812 11:17:24.412355 23762 ts_manager.cc:194] Registered new tserver with Master: 1761f348e6414e0e9f281746f68a303a (127.15.164.195:40611)
I20260812 11:17:24.416008 24075 heartbeater.cc:503] Master 127.15.164.254:41879 was elected leader, sending a full tablet report...
I20260812 11:17:24.420164 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:17:24.428283 24310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.425154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42018 (local address 127.15.164.254:41879)
0812 11:17:24.425357 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.425362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.426015 (+ 653us) server_negotiation.cc:407] Connection header received
0812 11:17:24.426219 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.426224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.426285 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.426407 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.427566 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.427571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.427575 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.427591 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.427624 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.427636 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.427775 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.427902 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.427955 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:17:24.432579 23762 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:24.439816 23762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:24.462939 24545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.453800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:46679 (local address 127.0.0.1:36780)
0812 11:17:24.455267 (+ 1467us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.455377 (+ 110us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.455562 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.460065 (+ 4503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.460078 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.460105 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.460752 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.460756 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.460788 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.460891 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.462056 (+ 1165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.462069 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.462077 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.462266 (+ 189us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.462362 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"thread_start_us":884,"threads_started":1}
I20260812 11:17:24.463191 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.454189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.15.164.194:46679)
0812 11:17:24.459468 (+ 5279us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.459477 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.459546 (+ 69us) server_negotiation.cc:407] Connection header received
0812 11:17:24.459621 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.459628 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.459833 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.460466 (+ 633us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.461813 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.461825 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.461844 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.461873 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.461937 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.461962 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.462109 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.462703 (+ 594us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.462815 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5078,"thread_start_us":4868,"threads_started":1}
I20260812 11:17:24.463398 24548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.455554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40611 (local address 127.0.0.1:51980)
0812 11:17:24.456609 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.456635 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.456846 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.459409 (+ 2563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.459420 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.459542 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.462010 (+ 2468us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.462015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.462034 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.462089 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.462552 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.462560 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.462567 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.462729 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.462857 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":1097,"threads_started":1}
I20260812 11:17:24.463963 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.457894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53690 (local address 127.15.164.193:37871)
0812 11:17:24.458934 (+ 1040us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.458947 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.459950 (+ 1003us) server_negotiation.cc:407] Connection header received
0812 11:17:24.460086 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.460094 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.460289 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.460459 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.462902 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.462911 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.462924 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.462945 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.463009 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.463037 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.463182 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.463485 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.463590 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832,"thread_start_us":650,"threads_started":1}
I20260812 11:17:24.464113 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.456192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51980 (local address 127.15.164.195:40611)
0812 11:17:24.458655 (+ 2463us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.458669 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.458722 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:17:24.458821 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.458833 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.459150 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.460206 (+ 1056us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.462253 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.462262 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.462276 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.462297 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.462357 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.462379 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.462590 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.463623 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.463731 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2140,"thread_start_us":1794,"threads_started":1}
I20260812 11:17:24.464762 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.458390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53690)
0812 11:17:24.459798 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.459818 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.459952 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.461566 (+ 1614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.461583 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.461606 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.462639 (+ 1033us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.462645 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.462665 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.462717 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.463304 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.463308 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.463313 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.464285 (+ 972us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.464346 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":1077,"threads_started":1}
I20260812 11:17:24.467953 23965 tablet_service.cc:1467] Processing CreateTablet for tablet af7744abb4834be3b2e0096566c873a4 (DEFAULT_TABLE table=test-table [id=c425fc4702b14050b3877b7c8c7b4b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:24.467975 24189 tablet_service.cc:1467] Processing CreateTablet for tablet af7744abb4834be3b2e0096566c873a4 (DEFAULT_TABLE table=test-table [id=c425fc4702b14050b3877b7c8c7b4b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:24.467975 24410 tablet_service.cc:1467] Processing CreateTablet for tablet af7744abb4834be3b2e0096566c873a4 (DEFAULT_TABLE table=test-table [id=c425fc4702b14050b3877b7c8c7b4b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:24.469301 23965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af7744abb4834be3b2e0096566c873a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:24.469470 24189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af7744abb4834be3b2e0096566c873a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:24.469465 24410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af7744abb4834be3b2e0096566c873a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:24.483640 24553 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Bootstrap starting.
I20260812 11:17:24.487345 24556 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Bootstrap starting.
I20260812 11:17:24.487887 24553 tablet_bootstrap.cc:654] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:24.489487 24553 log.cc:824] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:24.491703 24557 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Bootstrap starting.
I20260812 11:17:24.492164 24556 tablet_bootstrap.cc:654] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:24.493832 24556 log.cc:824] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:24.495721 24557 tablet_bootstrap.cc:654] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:24.497023 24557 log.cc:824] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:24.498370 24556 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: No bootstrap required, opened a new log
I20260812 11:17:24.498641 24553 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: No bootstrap required, opened a new log
I20260812 11:17:24.498713 24556 ts_tablet_manager.cc:1397] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260812 11:17:24.498941 24553 ts_tablet_manager.cc:1397] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260812 11:17:24.501004 24557 tablet_bootstrap.cc:492] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: No bootstrap required, opened a new log
I20260812 11:17:24.501281 24557 ts_tablet_manager.cc:1397] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260812 11:17:24.506158 24556 raft_consensus.cc:348] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.506595 24556 raft_consensus.cc:374] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:24.506693 24556 raft_consensus.cc:729] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629ab11d3c4049b0b060a45719c63f1a, State: Initialized, Role: FOLLOWER
I20260812 11:17:24.507407 24556 consensus_queue.cc:260] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.509944 24553 raft_consensus.cc:348] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.510443 24553 raft_consensus.cc:374] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:24.510571 24553 raft_consensus.cc:729] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a16adf71bc4c2896a888528daa0339, State: Initialized, Role: FOLLOWER
I20260812 11:17:24.511220 24553 consensus_queue.cc:260] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.511905 24305 heartbeater.cc:503] Master 127.15.164.254:41879 was elected leader, sending a full tablet report...
I20260812 11:17:24.512197 24557 raft_consensus.cc:348] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.512598 24556 ts_tablet_manager.cc:1428] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Time spent starting tablet: real 0.014s user 0.005s sys 0.008s
I20260812 11:17:24.512727 24557 raft_consensus.cc:374] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:24.512861 24557 raft_consensus.cc:729] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1761f348e6414e0e9f281746f68a303a, State: Initialized, Role: FOLLOWER
I20260812 11:17:24.513757 24557 consensus_queue.cc:260] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.515197 24553 ts_tablet_manager.cc:1428] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260812 11:17:24.516461 24529 heartbeater.cc:503] Master 127.15.164.254:41879 was elected leader, sending a full tablet report...
I20260812 11:17:24.518724 24557 ts_tablet_manager.cc:1428] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260812 11:17:24.629923 24563 raft_consensus.cc:482] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:24.630327 24563 raft_consensus.cc:504] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.632507 24563 leader_election.cc:288] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 629ab11d3c4049b0b060a45719c63f1a (127.15.164.194:46679), 1761f348e6414e0e9f281746f68a303a (127.15.164.195:40611)
I20260812 11:17:24.636958 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.633057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:44087 (local address 127.15.164.194:46679)
0812 11:17:24.633244 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.633250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.633948 (+ 698us) server_negotiation.cc:407] Connection header received
0812 11:17:24.634160 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.634166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.634238 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.634364 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.635967 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.635971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.635975 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.636025 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.636075 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.636112 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.636254 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.636536 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.636595 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:17:24.637259 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.632963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:46679 (local address 127.15.164.193:44087)
0812 11:17:24.633763 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.633786 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.633928 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.634563 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.634567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.634588 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.635662 (+ 1074us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.635666 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.635693 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.635761 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.636262 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.636270 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.636279 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.636482 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.636549 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":443,"threads_started":1}
I20260812 11:17:24.637562 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.634181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:44065 (local address 127.15.164.195:40611)
0812 11:17:24.634405 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.634413 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.634832 (+ 419us) server_negotiation.cc:407] Connection header received
0812 11:17:24.635032 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.635037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.635291 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.635421 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.636720 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.636726 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.636732 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.636755 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.636799 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.636816 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.636964 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.637249 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.637328 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 11:17:24.638217 24573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.633947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40611 (local address 127.15.164.193:44065)
0812 11:17:24.634707 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.634722 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:24.634876 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:24.635535 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:24.635541 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:24.635570 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:24.636423 (+ 853us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:17:24.636427 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:24.636449 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:17:24.636501 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:24.637039 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:24.637044 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:24.637049 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:17:24.637881 (+ 832us) client_negotiation.cc:240] Negotiation successful
0812 11:17:24.637925 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":386,"threads_started":1}
I20260812 11:17:24.638525 24228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af7744abb4834be3b2e0096566c873a4" candidate_uuid: "15a16adf71bc4c2896a888528daa0339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ab11d3c4049b0b060a45719c63f1a" is_pre_election: true
I20260812 11:17:24.639120 24228 raft_consensus.cc:2454] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a16adf71bc4c2896a888528daa0339 in term 0.
I20260812 11:17:24.639261 24450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af7744abb4834be3b2e0096566c873a4" candidate_uuid: "15a16adf71bc4c2896a888528daa0339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1761f348e6414e0e9f281746f68a303a" is_pre_election: true
I20260812 11:17:24.639807 24450 raft_consensus.cc:2454] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a16adf71bc4c2896a888528daa0339 in term 0.
I20260812 11:17:24.639923 23880 leader_election.cc:302] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a16adf71bc4c2896a888528daa0339, 629ab11d3c4049b0b060a45719c63f1a; no voters:
I20260812 11:17:24.640451 24563 raft_consensus.cc:2781] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:24.640619 24563 raft_consensus.cc:482] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:24.640743 24563 raft_consensus.cc:3037] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:24.643199 24563 raft_consensus.cc:504] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
I20260812 11:17:24.644265 24563 leader_election.cc:288] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [CANDIDATE]: Term 1 election: Requested vote from peers 629ab11d3c4049b0b060a45719c63f1a (127.15.164.194:46679), 1761f348e6414e0e9f281746f68a303a (127.15.164.195:40611)
I20260812 11:17:24.645051 24228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af7744abb4834be3b2e0096566c873a4" candidate_uuid: "15a16adf71bc4c2896a888528daa0339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "629ab11d3c4049b0b060a45719c63f1a"
I20260812 11:17:24.645314 24228 raft_consensus.cc:3037] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:24.645645 24450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af7744abb4834be3b2e0096566c873a4" candidate_uuid: "15a16adf71bc4c2896a888528daa0339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1761f348e6414e0e9f281746f68a303a"
I20260812 11:17:24.645879 24450 raft_consensus.cc:3037] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:24.648052 24228 raft_consensus.cc:2454] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a16adf71bc4c2896a888528daa0339 in term 1.
W20260812 11:17:24.648370 24076 tablet.cc:2369] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:24.648561 24450 raft_consensus.cc:2454] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a16adf71bc4c2896a888528daa0339 in term 1.
I20260812 11:17:24.648793 23880 leader_election.cc:302] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a16adf71bc4c2896a888528daa0339, 629ab11d3c4049b0b060a45719c63f1a; no voters:
W20260812 11:17:24.649184 24531 tablet.cc:2369] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:24.649575 24563 raft_consensus.cc:2781] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:24.650254 24563 raft_consensus.cc:686] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 1 LEADER]: Becoming Leader. State: Replica: 15a16adf71bc4c2896a888528daa0339, State: Running, Role: LEADER
I20260812 11:17:24.651006 24563 consensus_queue.cc:237] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } }
W20260812 11:17:24.657187 24307 tablet.cc:2369] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:24.659024 23761 catalog_manager.cc:5495] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a16adf71bc4c2896a888528daa0339 (127.15.164.193). New cstate: current_term: 1 leader_uuid: "15a16adf71bc4c2896a888528daa0339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a16adf71bc4c2896a888528daa0339" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37871 } health_report { overall_health: HEALTHY } } }
I20260812 11:17:24.716624 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.713275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.15.164.193:37871)
0812 11:17:24.713469 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.713474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.713923 (+ 449us) server_negotiation.cc:407] Connection header received
0812 11:17:24.714234 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.714238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.714352 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.714451 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.715590 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.715597 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.715614 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.715639 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.715694 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.715713 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.715857 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.716217 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.716315 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:17:24.728660 24228 raft_consensus.cc:1261] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 1 FOLLOWER]: Refusing update from remote peer 15a16adf71bc4c2896a888528daa0339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:24.728706 24450 raft_consensus.cc:1261] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 1 FOLLOWER]: Refusing update from remote peer 15a16adf71bc4c2896a888528daa0339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:24.729898 24575 consensus_queue.cc:1035] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1761f348e6414e0e9f281746f68a303a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:24.730314 24563 consensus_queue.cc:1035] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "629ab11d3c4049b0b060a45719c63f1a" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:24.754022 24579 mvcc.cc:205] Tried to move back new op lower bound from 7317640989594914816 to 7317640989299056640. Current Snapshot: MvccSnapshot[applied={T|T < 7317640989594914816 or (T in {7317640989594914816})}]
I20260812 11:17:24.770851 23759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:24.771257 23759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:24.777177 23759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7df3a6636a48445ba8c0a8d075a83c24: Sending DeleteTablet for 3 replicas of tablet af7744abb4834be3b2e0096566c873a4
I20260812 11:17:24.778637 23965 tablet_service.cc:1514] Processing DeleteTablet for tablet af7744abb4834be3b2e0096566c873a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:24 UTC) from {username='slave'} at 127.0.0.1:53690
I20260812 11:17:24.779050 24189 tablet_service.cc:1514] Processing DeleteTablet for tablet af7744abb4834be3b2e0096566c873a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:24 UTC) from {username='slave'} at 127.0.0.1:36780
I20260812 11:17:24.779737 24410 tablet_service.cc:1514] Processing DeleteTablet for tablet af7744abb4834be3b2e0096566c873a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:24 UTC) from {username='slave'} at 127.0.0.1:51980
I20260812 11:17:24.780369 24408 tablet_service.cc:1514] Processing DeleteTablet for tablet af7744abb4834be3b2e0096566c873a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:24 UTC) from {username='slave'} at 127.0.0.1:51980
I20260812 11:17:24.780665 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 23852
I20260812 11:17:24.789093 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.782842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53716 (local address 127.15.164.193:37871)
0812 11:17:24.783075 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.783085 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.786112 (+ 3027us) server_negotiation.cc:407] Connection header received
0812 11:17:24.786280 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.786289 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.786382 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.786534 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.788095 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.788105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.788113 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.788142 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.788196 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.788218 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.788385 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.788611 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.788677 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:17:24.789791 24607 tablet_replica.cc:330] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: stopping tablet replica
I20260812 11:17:24.789948 24064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:24.790354 24607 raft_consensus.cc:2229] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:24.792335 24607 raft_consensus.cc:2258] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:24.794835 24600 tablet_replica.cc:330] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: stopping tablet replica
I20260812 11:17:24.795312 24600 raft_consensus.cc:2229] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:24.795825 24600 raft_consensus.cc:2258] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:24.796146 24607 ts_tablet_manager.cc:1905] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:24.798995 24600 ts_tablet_manager.cc:1905] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:24.806664 24600 ts_tablet_manager.cc:1918] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:24.806877 24600 log.cc:1196] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/af7744abb4834be3b2e0096566c873a4
I20260812 11:17:24.807739 24600 ts_tablet_manager.cc:1939] T af7744abb4834be3b2e0096566c873a4 P 629ab11d3c4049b0b060a45719c63f1a: Deleting consensus metadata
I20260812 11:17:24.809985 23743 catalog_manager.cc:4841] TS 629ab11d3c4049b0b060a45719c63f1a (127.15.164.194:46679): tablet af7744abb4834be3b2e0096566c873a4 (table test-table [id=c425fc4702b14050b3877b7c8c7b4b40]) successfully deleted
I20260812 11:17:24.813109 24607 ts_tablet_manager.cc:1918] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:24.813376 24607 log.cc:1196] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/af7744abb4834be3b2e0096566c873a4
I20260812 11:17:24.814110 24607 ts_tablet_manager.cc:1939] T af7744abb4834be3b2e0096566c873a4 P 1761f348e6414e0e9f281746f68a303a: Deleting consensus metadata
I20260812 11:17:24.816712 23743 catalog_manager.cc:4841] TS 1761f348e6414e0e9f281746f68a303a (127.15.164.195:40611): tablet af7744abb4834be3b2e0096566c873a4 (table test-table [id=c425fc4702b14050b3877b7c8c7b4b40]) successfully deleted
W20260812 11:17:24.817447 23743 catalog_manager.cc:4808] TS 1761f348e6414e0e9f281746f68a303a (127.15.164.195:40611): delete failed for tablet af7744abb4834be3b2e0096566c873a4 because the tablet was not found. No further retry: Not found: Tablet not found: af7744abb4834be3b2e0096566c873a4
I20260812 11:17:24.912112 24599 tablet_replica.cc:330] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339: stopping tablet replica
I20260812 11:17:24.912649 24599 raft_consensus.cc:2229] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:24.913362 24599 raft_consensus.cc:2258] T af7744abb4834be3b2e0096566c873a4 P 15a16adf71bc4c2896a888528daa0339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:24.914891 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 23852
I20260812 11:17:24.951514 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 24083
W20260812 11:17:24.951586 23746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.164.193:37871 (error 108)
I20260812 11:17:24.954360 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.953468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53730)
0812 11:17:24.953969 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:24.954164 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260812 11:17:24.954794 23746 catalog_manager.cc:4584] TS 15a16adf71bc4c2896a888528daa0339 (127.15.164.193:37871): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet af7744abb4834be3b2e0096566c873a4: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
I20260812 11:17:24.961777 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:24.952546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36788 (local address 127.15.164.194:46679)
0812 11:17:24.952765 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:24.952771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:24.952800 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:17:24.952902 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:24.952907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:24.953024 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:24.953166 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:24.960538 (+ 7372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:24.960545 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:24.960549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:24.960577 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:24.960632 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:24.960649 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:24.960827 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:24.961097 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 11:17:24.961268 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:17:24.963446 24298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:25.008822 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.008166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53744)
0812 11:17:25.008460 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.008614 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260812 11:17:25.010182 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.009750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53754)
0812 11:17:25.009928 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.010020 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:17:25.066483 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 24083
I20260812 11:17:25.071709 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.071188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53756)
0812 11:17:25.071413 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.071527 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:17:25.072854 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.072467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53768)
0812 11:17:25.072644 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.072728 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 11:17:25.093207 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 24314
I20260812 11:17:25.096607 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.094090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51990 (local address 127.15.164.195:40611)
0812 11:17:25.094287 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:25.094293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:25.094323 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:17:25.094441 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:25.094445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:25.094622 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:25.094713 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:25.095894 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:25.095898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:25.095902 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:25.095918 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:25.095951 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:25.095963 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:25.096078 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:25.096198 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:17:25.096255 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:17:25.097316 24519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:25.153616 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.153028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53776)
0812 11:17:25.153307 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.153421 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 11:17:25.155191 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.154665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53782)
0812 11:17:25.154895 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.154970 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 11:17:25.192724 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 24314
I20260812 11:17:25.222523 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 23715
I20260812 11:17:25.224058 23812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:25.338207 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.337533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37871 (local address 127.0.0.1:53798)
0812 11:17:25.337879 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:25.338026 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:37871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260812 11:17:25.338222 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 23715
2026-08-12T11:17:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3093 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 11:17:25.393357 16019 mini_oidc.cc:152] Starting JWKS server
I20260812 11:17:25.396557 16019 webserver.cc:460] Webserver started at https://127.0.0.1:44305/ using document root <none> and password file <none>
I20260812 11:17:25.396898 16019 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:17:25.397539 16019 webserver.cc:460] Webserver started at http://127.0.0.1:45241/ using document root <none> and password file <none>
2026-08-12T11:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:25Z Disabled control of system clock
I20260812 11:17:25.435338 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40695
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:39893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40695
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44305/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/testchainca.cert with env {}
W20260812 11:17:25.797607 24622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:25.798015 24622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:25.798158 24622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:25.805943 24622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:25.806074 24622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:25.806152 24622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:25.806269 24622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:25.806345 24622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:17:25.806440 24622 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:17:25.806517 24622 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44305/jwks.json
I20260812 11:17:25.818619 24622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:39893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40695
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44305/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:25.820223 24622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:25.821702 24622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:25.834442 24640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:25.834514 24631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:25.835086 24628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:25.836004 24622 server_base.cc:1034] running on GCE node
I20260812 11:17:25.836974 24622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:25.838778 24622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:25.840063 24622 hybrid_clock.cc:648] HybridClock initialized: now 1786533445840017 us; error 41 us; skew 500 ppm
I20260812 11:17:25.840517 24622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:25.843295 24622 webserver.cc:460] Webserver started at http://127.15.164.254:41317/ using document root <none> and password file <none>
I20260812 11:17:25.844254 24622 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:25.844406 24622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:25.844763 24622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:25.848140 24622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "50fe6e466ec644b786f5819c0ab4c03b"
format_stamp: "Formatted at 2026-08-12 11:17:25 on dist-test-slave-7kzw"
server_key: "c1f50ac271206d4b5cbddedbab5004b4"
server_key_iv: "d5d383f135603c5b855c9333c280ad94"
server_key_version: "encryptionkey@0"
I20260812 11:17:25.849069 24622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "50fe6e466ec644b786f5819c0ab4c03b"
format_stamp: "Formatted at 2026-08-12 11:17:25 on dist-test-slave-7kzw"
server_key: "c1f50ac271206d4b5cbddedbab5004b4"
server_key_iv: "d5d383f135603c5b855c9333c280ad94"
server_key_version: "encryptionkey@0"
I20260812 11:17:25.855360 24622 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:17:25.859577 24655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:25.861291 24622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:17:25.861526 24622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "50fe6e466ec644b786f5819c0ab4c03b"
format_stamp: "Formatted at 2026-08-12 11:17:25 on dist-test-slave-7kzw"
server_key: "c1f50ac271206d4b5cbddedbab5004b4"
server_key_iv: "d5d383f135603c5b855c9333c280ad94"
server_key_version: "encryptionkey@0"
I20260812 11:17:25.861785 24622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:25.881384 24622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:25.882493 24622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:25.882866 24622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:25.905164 24622 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40695
I20260812 11:17:25.905205 24740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40695 every 8 connection(s)
I20260812 11:17:25.906883 24622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:25.911600 24741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:25.912756 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 24622
I20260812 11:17:25.913017 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:25.913848 16019 external_mini_cluster.cc:1428] Setting key ebdf20e85b0a47617697f4f1817a2e9e
I20260812 11:17:25.927310 24741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b: Bootstrap starting.
I20260812 11:17:25.929848 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:25.916402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56264 (local address 127.15.164.254:40695)
0812 11:17:25.917656 (+ 1254us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:25.917670 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:25.917723 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:17:25.919611 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:25.919641 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:25.920251 (+ 610us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:25.920724 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:25.921385 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:25.923305 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:25.924813 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:25.925577 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:25.925815 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:25.927214 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:25.927223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:25.927252 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:25.927938 (+ 686us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:25.928028 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:25.928057 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:25.928202 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:25.928449 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 11:17:25.928809 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":469,"threads_started":1}
I20260812 11:17:25.931443 24741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:25.932646 24741 log.cc:824] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:25.934705 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:17:25.936076 24741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b: No bootstrap required, opened a new log
I20260812 11:17:25.943959 24741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } }
I20260812 11:17:25.944391 24741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:25.944528 24741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50fe6e466ec644b786f5819c0ab4c03b, State: Initialized, Role: FOLLOWER
I20260812 11:17:25.945271 24741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } }
I20260812 11:17:25.945853 24741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:25.946048 24741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:25.946249 24741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:25.948753 24741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } }
I20260812 11:17:25.949393 24741 leader_election.cc:302] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50fe6e466ec644b786f5819c0ab4c03b; no voters:
I20260812 11:17:25.950161 24741 leader_election.cc:288] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:25.950372 24754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:25.951834 24754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [term 1 LEADER]: Becoming Leader. State: Replica: 50fe6e466ec644b786f5819c0ab4c03b, State: Running, Role: LEADER
I20260812 11:17:25.952527 24754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } }
I20260812 11:17:25.952700 24741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:25.956607 24755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50fe6e466ec644b786f5819c0ab4c03b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } } }
I20260812 11:17:25.957213 24755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:25.957118 24756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50fe6e466ec644b786f5819c0ab4c03b. Latest consensus state: current_term: 1 leader_uuid: "50fe6e466ec644b786f5819c0ab4c03b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fe6e466ec644b786f5819c0ab4c03b" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40695 } } }
I20260812 11:17:25.957482 24756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:25.963668 24761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:25.970886 24761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:25.983628 24761 catalog_manager.cc:1347] Generated new cluster ID: d26056db9c7d4907a4197f5e488b1285
I20260812 11:17:25.984033 24761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:26.008282 24761 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:26.009972 24761 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:26.020478 24761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50fe6e466ec644b786f5819c0ab4c03b: Generated new TSK 0
I20260812 11:17:26.021544 24761 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:17:26.078913 24801 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 11:17:26.079205 24801 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:17:26.080328 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:26.053884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.15.164.254:40695)
0812 11:17:26.054149 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:26.054161 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:26.055411 (+ 1250us) server_negotiation.cc:407] Connection header received
0812 11:17:26.055767 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:26.055772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:26.055860 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:26.056183 (+ 323us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:17:26.057255 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.058163 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.060851 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.061358 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.061477 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:26.062328 (+ 851us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:17:26.079753 (+ 17425us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:17:26.080083 (+ 330us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56266: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 11:17:26.080500 24746 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56266: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 11:17:26.083242 24799 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:26.053736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40695 (local address 127.0.0.1:56266)
0812 11:17:26.054945 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:26.054971 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:26.055251 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:26.056378 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:26.056385 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:26.056403 (+ 18us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:17:26.056988 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:26.057005 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.058383 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.058390 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:26.060577 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:26.060601 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.061587 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.061596 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:26.061802 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:26.061919 (+ 117us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:17:26.080112 (+ 18193us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:17:26.080524 (+ 412us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.164.254:40695: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":952,"thread_start_us":741,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.164.254:40695: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 11:17:26.085506 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 24622
I20260812 11:17:26.087155 24733 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:26.190752 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 24622
2026-08-12T11:17:26Z chronyd exiting
I20260812 11:17:26.263450 16019 test_util.cc:175] -----------------------------------------------
I20260812 11:17:26.263751 16019 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786533397360424-16019-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (875 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 11:17:26.268347 16019 mini_oidc.cc:152] Starting JWKS server
I20260812 11:17:26.271534 16019 webserver.cc:460] Webserver started at https://127.0.0.1:32977/ using document root <none> and password file <none>
I20260812 11:17:26.271935 16019 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:17:26.272800 16019 webserver.cc:460] Webserver started at http://127.0.0.1:43311/ using document root <none> and password file <none>
2026-08-12T11:17:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:26Z Disabled control of system clock
I20260812 11:17:26.311129 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45907
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:45907
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32977/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/testchainca.cert with env {}
W20260812 11:17:26.692581 24812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:26.692988 24812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:26.693169 24812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:26.700699 24812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:26.700898 24812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:26.701001 24812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:26.701118 24812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:26.701210 24812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:17:26.701313 24812 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:17:26.701395 24812 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32977/jwks.json
I20260812 11:17:26.712815 24812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:45907
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:45907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32977/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:26.714380 24812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:26.715921 24812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:26.729821 24824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:26.729878 24827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:26.730027 24830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:26.730625 24812 server_base.cc:1034] running on GCE node
I20260812 11:17:26.731892 24812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:26.733664 24812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:26.734927 24812 hybrid_clock.cc:648] HybridClock initialized: now 1786533446734878 us; error 50 us; skew 500 ppm
I20260812 11:17:26.735359 24812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:26.738020 24812 webserver.cc:460] Webserver started at http://127.15.164.254:43789/ using document root <none> and password file <none>
I20260812 11:17:26.738875 24812 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:26.739022 24812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:26.739410 24812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:26.743567 24812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "20aa7276854848f987039fb853d642ad"
format_stamp: "Formatted at 2026-08-12 11:17:26 on dist-test-slave-7kzw"
server_key: "ffab8ab20a3c890e8a769edb45b6d9f8"
server_key_iv: "e707fad302629f9a11abd3608296fb41"
server_key_version: "encryptionkey@0"
I20260812 11:17:26.744484 24812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "20aa7276854848f987039fb853d642ad"
format_stamp: "Formatted at 2026-08-12 11:17:26 on dist-test-slave-7kzw"
server_key: "ffab8ab20a3c890e8a769edb45b6d9f8"
server_key_iv: "e707fad302629f9a11abd3608296fb41"
server_key_version: "encryptionkey@0"
I20260812 11:17:26.750433 24812 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 11:17:26.754952 24842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:26.757455 24812 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.003s
I20260812 11:17:26.757740 24812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "20aa7276854848f987039fb853d642ad"
format_stamp: "Formatted at 2026-08-12 11:17:26 on dist-test-slave-7kzw"
server_key: "ffab8ab20a3c890e8a769edb45b6d9f8"
server_key_iv: "e707fad302629f9a11abd3608296fb41"
server_key_version: "encryptionkey@0"
I20260812 11:17:26.758026 24812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:26.793090 24812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:26.794113 24812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:26.794492 24812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:26.819976 24812 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:45907
I20260812 11:17:26.819990 24936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:45907 every 8 connection(s)
I20260812 11:17:26.822671 24812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:26.828081 24939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:26.830956 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 24812
I20260812 11:17:26.831192 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:26.831884 16019 external_mini_cluster.cc:1428] Setting key d581a0982016a324a05cb4f16f9cf3d2
I20260812 11:17:26.842974 24939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad: Bootstrap starting.
I20260812 11:17:26.847795 24939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:26.849843 24939 log.cc:824] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:26.850786 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:26.834219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.15.164.254:45907)
0812 11:17:26.835468 (+ 1249us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:26.835485 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:26.835543 (+ 58us) server_negotiation.cc:407] Connection header received
0812 11:17:26.838004 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:26.838047 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:26.838834 (+ 787us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:26.839378 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:26.840348 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.842268 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.843869 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.845042 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.845269 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:26.846788 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:26.846801 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:26.846822 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:26.847794 (+ 972us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:26.847960 (+ 166us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:26.847999 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:26.848180 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:26.848501 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 11:17:26.848986 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":401,"threads_started":1}
I20260812 11:17:26.853578 24939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad: No bootstrap required, opened a new log
I20260812 11:17:26.855916 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:17:26.862783 24939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } }
I20260812 11:17:26.863220 24939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:26.863368 24939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20aa7276854848f987039fb853d642ad, State: Initialized, Role: FOLLOWER
I20260812 11:17:26.864408 24939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } }
I20260812 11:17:26.864892 24939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:26.865111 24939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:26.865311 24939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:26.868258 24939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } }
I20260812 11:17:26.869166 24939 leader_election.cc:302] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20aa7276854848f987039fb853d642ad; no voters:
I20260812 11:17:26.869956 24939 leader_election.cc:288] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:26.870267 24957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:26.871078 24957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [term 1 LEADER]: Becoming Leader. State: Replica: 20aa7276854848f987039fb853d642ad, State: Running, Role: LEADER
I20260812 11:17:26.871779 24957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } }
I20260812 11:17:26.872969 24939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:26.875301 24961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20aa7276854848f987039fb853d642ad. Latest consensus state: current_term: 1 leader_uuid: "20aa7276854848f987039fb853d642ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } } }
I20260812 11:17:26.875854 24961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:26.876776 24958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20aa7276854848f987039fb853d642ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20aa7276854848f987039fb853d642ad" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 45907 } } }
I20260812 11:17:26.877207 24958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:26.879748 24970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:26.884771 24970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:26.895762 24970 catalog_manager.cc:1347] Generated new cluster ID: 7d946f92acf9428aa3aa746342e612b7
I20260812 11:17:26.896026 24970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:26.914881 24970 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:26.916970 24970 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:26.934541 24970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20aa7276854848f987039fb853d642ad: Generated new TSK 0
I20260812 11:17:26.935550 24970 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:17:26.981575 25005 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 11:17:26.981963 25005 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:17:26.982551 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:26.957785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36646 (local address 127.15.164.254:45907)
0812 11:17:26.958099 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:26.958106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:26.959234 (+ 1128us) server_negotiation.cc:407] Connection header received
0812 11:17:26.959555 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:26.959561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:26.959677 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:26.959888 (+ 211us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:17:26.960421 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.961635 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.963483 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.964270 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.964416 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:26.965156 (+ 740us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:17:26.981630 (+ 16474us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32977/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:17:26.982178 (+ 548us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36646: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32977/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":97}
W20260812 11:17:26.982692 24951 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36646: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32977/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 11:17:26.982873 25003 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:26.957658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:45907 (local address 127.0.0.1:36646)
0812 11:17:26.959098 (+ 1440us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:26.959117 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:26.959274 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:26.959933 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:26.959937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:26.959948 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:17:26.960238 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:26.960245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.962065 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.962071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:26.963314 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:26.963328 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:26.964659 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:26.964665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:26.964810 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:26.964851 (+ 41us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:17:26.982127 (+ 17276us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32977/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:17:26.982420 (+ 293us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.164.254:45907: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32977/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":643,"threads_started":1}
I20260812 11:17:26.985603 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 24812
I20260812 11:17:26.987458 24929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:27.094834 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 24812
2026-08-12T11:17:27Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (901 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 11:17:27.169265 16019 mini_oidc.cc:152] Starting JWKS server
I20260812 11:17:27.171403 16019 webserver.cc:460] Webserver started at https://127.0.0.1:33119/ using document root <none> and password file <none>
I20260812 11:17:27.171685 16019 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:17:27.172426 16019 webserver.cc:460] Webserver started at http://127.0.0.1:33557/ using document root <none> and password file <none>
2026-08-12T11:17:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:27Z Disabled control of system clock
I20260812 11:17:27.212213 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:37161
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:45713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:37161
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33119/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:17:27.616832 25017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:27.617295 25017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:27.617475 25017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:27.627483 25017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:27.627789 25017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:27.627895 25017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:27.628010 25017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:27.628100 25017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:17:27.628196 25017 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:17:27.628288 25017 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33119/jwks.json
I20260812 11:17:27.638370 25017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:37161
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:37161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33119/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:27.640341 25017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:27.642444 25017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:27.656940 25025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:27.656884 25027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:27.656916 25032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:27.658936 25017 server_base.cc:1034] running on GCE node
I20260812 11:17:27.660043 25017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:27.666916 25017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:27.668228 25017 hybrid_clock.cc:648] HybridClock initialized: now 1786533447668140 us; error 88 us; skew 500 ppm
I20260812 11:17:27.668923 25017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:27.672843 25017 webserver.cc:460] Webserver started at http://127.15.164.254:41797/ using document root <none> and password file <none>
I20260812 11:17:27.673753 25017 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:27.673915 25017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:27.674316 25017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:27.677700 25017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "be8388e5a9474609ab85a003dc77980a"
format_stamp: "Formatted at 2026-08-12 11:17:27 on dist-test-slave-7kzw"
server_key: "1bfbf3e8fa41f0ef837825c79d4082f5"
server_key_iv: "3be166fd411e816d54400172a0d7451b"
server_key_version: "encryptionkey@0"
I20260812 11:17:27.678706 25017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "be8388e5a9474609ab85a003dc77980a"
format_stamp: "Formatted at 2026-08-12 11:17:27 on dist-test-slave-7kzw"
server_key: "1bfbf3e8fa41f0ef837825c79d4082f5"
server_key_iv: "3be166fd411e816d54400172a0d7451b"
server_key_version: "encryptionkey@0"
I20260812 11:17:27.684767 25017 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:27.689267 25046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:27.691114 25017 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:17:27.691375 25017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "be8388e5a9474609ab85a003dc77980a"
format_stamp: "Formatted at 2026-08-12 11:17:27 on dist-test-slave-7kzw"
server_key: "1bfbf3e8fa41f0ef837825c79d4082f5"
server_key_iv: "3be166fd411e816d54400172a0d7451b"
server_key_version: "encryptionkey@0"
I20260812 11:17:27.691663 25017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:27.710098 25017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:27.711184 25017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:27.711566 25017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:27.734313 25017 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:37161
I20260812 11:17:27.734349 25128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:37161 every 8 connection(s)
I20260812 11:17:27.735883 25017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:27.740636 25129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:27.742456 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25017
I20260812 11:17:27.742797 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:27.743831 16019 external_mini_cluster.cc:1428] Setting key 31d1d9c2d06bdac5a9520fedb76aa8df
I20260812 11:17:27.754921 25129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a: Bootstrap starting.
I20260812 11:17:27.759172 25129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:27.760964 25129 log.cc:824] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:27.763756 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:27.746429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44274 (local address 127.15.164.254:37161)
0812 11:17:27.747997 (+ 1568us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:27.748010 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:27.748067 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:17:27.749988 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:27.750016 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:27.750668 (+ 652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:27.751144 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:27.751863 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.753385 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.755036 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.756107 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.756372 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:27.757835 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:27.757844 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:27.757860 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:27.758527 (+ 667us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:27.758655 (+ 128us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:27.759181 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:27.759368 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:27.760373 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0812 11:17:27.761842 (+ 1469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994,"thread_start_us":693,"threads_started":1}
I20260812 11:17:27.765486 25129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a: No bootstrap required, opened a new log
I20260812 11:17:27.768608 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:17:27.778573 25129 raft_consensus.cc:348] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } }
I20260812 11:17:27.779076 25129 raft_consensus.cc:374] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:27.779412 25129 raft_consensus.cc:729] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8388e5a9474609ab85a003dc77980a, State: Initialized, Role: FOLLOWER
I20260812 11:17:27.780303 25129 consensus_queue.cc:260] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } }
I20260812 11:17:27.781025 25129 raft_consensus.cc:388] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:27.781212 25129 raft_consensus.cc:482] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:27.781661 25129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:27.784870 25129 raft_consensus.cc:504] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } }
I20260812 11:17:27.786056 25129 leader_election.cc:302] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be8388e5a9474609ab85a003dc77980a; no voters:
I20260812 11:17:27.787038 25129 leader_election.cc:288] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:27.787479 25135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:27.788650 25135 raft_consensus.cc:686] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [term 1 LEADER]: Becoming Leader. State: Replica: be8388e5a9474609ab85a003dc77980a, State: Running, Role: LEADER
I20260812 11:17:27.789674 25135 consensus_queue.cc:237] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } }
I20260812 11:17:27.790730 25129 sys_catalog.cc:564] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:27.793234 25141 sys_catalog.cc:455] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [sys.catalog]: SysCatalogTable state changed. Reason: New leader be8388e5a9474609ab85a003dc77980a. Latest consensus state: current_term: 1 leader_uuid: "be8388e5a9474609ab85a003dc77980a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } } }
I20260812 11:17:27.793202 25139 sys_catalog.cc:455] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be8388e5a9474609ab85a003dc77980a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be8388e5a9474609ab85a003dc77980a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37161 } } }
I20260812 11:17:27.793741 25139 sys_catalog.cc:458] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:27.793741 25141 sys_catalog.cc:458] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:27.799481 25149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:27.806407 25149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:27.818994 25149 catalog_manager.cc:1347] Generated new cluster ID: 6629e08f81bd4d77a079a8635c6de216
I20260812 11:17:27.819155 25149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:27.830026 25149 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:27.832099 25149 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:27.844612 25149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be8388e5a9474609ab85a003dc77980a: Generated new TSK 0
I20260812 11:17:27.846079 25149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:17:27.882009 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:27.872103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.15.164.254:37161)
0812 11:17:27.872329 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:27.872336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:27.872912 (+ 576us) server_negotiation.cc:407] Connection header received
0812 11:17:27.873218 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:27.873223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:27.873308 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:27.873540 (+ 232us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:17:27.874061 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.874918 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.876380 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.876843 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.876987 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:27.878116 (+ 1129us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:17:27.881263 (+ 3147us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:17:27.881677 (+ 414us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44278: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 11:17:27.882154 25133 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44278: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 11:17:27.884208 25182 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:27.872088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:37161 (local address 127.0.0.1:44278)
0812 11:17:27.872788 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:27.872806 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:27.872951 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:27.873552 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:27.873557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:27.873570 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:17:27.873887 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:27.873896 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.875073 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.875081 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:27.876205 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:27.876218 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:27.877054 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:27.877063 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:27.877339 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:27.877387 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:17:27.881549 (+ 4162us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:17:27.883720 (+ 2171us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.164.254:37161: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33119/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":1752,"thread_start_us":371,"threads_started":1}
I20260812 11:17:27.885710 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25017
I20260812 11:17:27.887276 25121 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 11:17:27.896008 25183 webserver.cc:533] Webserver: sslize failed:
E20260812 11:17:27.896239 25183 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:17:27.989635 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25017
2026-08-12T11:17:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (895 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T11:17:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:28Z Disabled control of system clock
I20260812 11:17:28.104760 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:38367
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:38367
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/testchainca.cert with env {}
W20260812 11:17:28.487291 25190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:28.487654 25190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:28.487823 25190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:28.495505 25190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:28.495654 25190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:28.495698 25190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:28.495859 25190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:28.495934 25190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:17:28.495999 25190 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:17:28.496034 25190 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 11:17:28.506858 25190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:38367
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:38367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:28.508765 25190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:28.510456 25190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:28.524689 25199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:28.524906 25201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:28.525305 25190 server_base.cc:1034] running on GCE node
W20260812 11:17:28.524909 25204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:28.526433 25190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:28.528106 25190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:28.529402 25190 hybrid_clock.cc:648] HybridClock initialized: now 1786533448529329 us; error 68 us; skew 500 ppm
I20260812 11:17:28.529908 25190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:17:28.533032 25190 webserver.cc:460] Webserver started at http://127.15.164.254:42251/ using document root <none> and password file <none>
I20260812 11:17:28.533918 25190 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:28.534082 25190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:28.534525 25190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:28.537926 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "1bffafd4464742aaa7294578c9c6ffac"
format_stamp: "Formatted at 2026-08-12 11:17:28 on dist-test-slave-7kzw"
server_key: "4c56827bbb722f9b83e84c360199913b"
server_key_iv: "fb278aac1ae4b92cb1215570f058383d"
server_key_version: "encryptionkey@0"
I20260812 11:17:28.538980 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "1bffafd4464742aaa7294578c9c6ffac"
format_stamp: "Formatted at 2026-08-12 11:17:28 on dist-test-slave-7kzw"
server_key: "4c56827bbb722f9b83e84c360199913b"
server_key_iv: "fb278aac1ae4b92cb1215570f058383d"
server_key_version: "encryptionkey@0"
I20260812 11:17:28.545295 25190 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:28.549575 25215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:28.551877 25190 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260812 11:17:28.552172 25190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "1bffafd4464742aaa7294578c9c6ffac"
format_stamp: "Formatted at 2026-08-12 11:17:28 on dist-test-slave-7kzw"
server_key: "4c56827bbb722f9b83e84c360199913b"
server_key_iv: "fb278aac1ae4b92cb1215570f058383d"
server_key_version: "encryptionkey@0"
I20260812 11:17:28.552475 25190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:28.585481 25190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:28.586530 25190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:28.586862 25190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:28.610534 25190 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:38367
I20260812 11:17:28.610589 25304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:38367 every 8 connection(s)
I20260812 11:17:28.612250 25190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:28.614403 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25190
I20260812 11:17:28.614650 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:28.615540 16019 external_mini_cluster.cc:1428] Setting key 667ca851915805b1a9c2661c2bb3bb11
I20260812 11:17:28.617683 25307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:28.633600 25314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:28.618041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48142 (local address 127.15.164.254:38367)
0812 11:17:28.619389 (+ 1348us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:28.619405 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:28.619574 (+ 169us) server_negotiation.cc:407] Connection header received
0812 11:17:28.621696 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:28.621728 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:28.622445 (+ 717us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:28.622975 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:28.623592 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.625724 (+ 2132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.627666 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.628781 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.628995 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:28.630323 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:28.630340 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:28.630362 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:17:28.631236 (+ 874us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:28.631350 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:17:28.631381 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:28.631516 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:28.631817 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 11:17:28.632183 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":785,"thread_start_us":469,"threads_started":1}
I20260812 11:17:28.634040 25307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac: Bootstrap starting.
I20260812 11:17:28.637887 25307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:28.639284 25307 log.cc:824] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:28.639878 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:17:28.643157 25307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac: No bootstrap required, opened a new log
I20260812 11:17:28.651715 25307 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } }
I20260812 11:17:28.652199 25307 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:28.652348 25307 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bffafd4464742aaa7294578c9c6ffac, State: Initialized, Role: FOLLOWER
I20260812 11:17:28.653064 25307 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } }
I20260812 11:17:28.653353 25307 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:28.653525 25307 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:28.653753 25307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:28.657127 25307 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } }
I20260812 11:17:28.657848 25307 leader_election.cc:302] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bffafd4464742aaa7294578c9c6ffac; no voters:
I20260812 11:17:28.658571 25307 leader_election.cc:288] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:28.658954 25319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:28.659740 25319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [term 1 LEADER]: Becoming Leader. State: Replica: 1bffafd4464742aaa7294578c9c6ffac, State: Running, Role: LEADER
I20260812 11:17:28.660323 25319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } }
I20260812 11:17:28.661136 25307 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:28.664952 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bffafd4464742aaa7294578c9c6ffac. Latest consensus state: current_term: 1 leader_uuid: "1bffafd4464742aaa7294578c9c6ffac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } } }
I20260812 11:17:28.665760 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:28.665547 25320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bffafd4464742aaa7294578c9c6ffac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bffafd4464742aaa7294578c9c6ffac" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 38367 } } }
I20260812 11:17:28.666154 25320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:28.668769 25332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:28.674324 25332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:28.686571 25332 catalog_manager.cc:1347] Generated new cluster ID: 2e6372dc917b4e8bb75c08bd4626ab41
I20260812 11:17:28.686738 25332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:28.714061 25332 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:28.716130 25332 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:28.729621 25332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bffafd4464742aaa7294578c9c6ffac: Generated new TSK 0
I20260812 11:17:28.731025 25332 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:17:28.777117 25314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:28.750026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48146 (local address 127.15.164.254:38367)
0812 11:17:28.750253 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:28.750260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:28.750531 (+ 271us) server_negotiation.cc:407] Connection header received
0812 11:17:28.750819 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:28.750825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:28.750930 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:28.751141 (+ 211us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:17:28.751692 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.753194 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.755320 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.756410 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.756629 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:28.757305 (+ 676us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:17:28.775969 (+ 18664us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:17:28.776716 (+ 747us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48146: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":92}
W20260812 11:17:28.777338 25314 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48146: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 11:17:28.777458 25353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:28.749770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:38367 (local address 127.0.0.1:48146)
0812 11:17:28.750406 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:28.750422 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:28.750616 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:28.751177 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:28.751181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:28.751201 (+ 20us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:17:28.751516 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:28.751525 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.753651 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.753656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:28.755042 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:28.755058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:28.756706 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:28.756713 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:28.756860 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:28.756932 (+ 72us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:17:28.776437 (+ 19505us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:17:28.776960 (+ 523us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.164.254:38367: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":327,"threads_started":1}
I20260812 11:17:28.778932 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25190
I20260812 11:17:28.780288 25293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:28.881474 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25190
2026-08-12T11:17:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (865 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (498 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1696 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:31 dist-test-slave-7kzw krb5kdc[25378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:31 dist-test-slave-7kzw krb5kdc[25378](info): set up 2 sockets
Aug 12 11:17:31 dist-test-slave-7kzw krb5kdc[25378](info): commencing operation
krb5kdc: starting...
W20260812 11:17:32.525071 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.396s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:32 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:32.817121 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40481
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40481
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:33.228552 25402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:33.228919 25402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:33.229082 25402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:33.238049 25402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:33.238216 25402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:33.238307 25402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:33.238411 25402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:33.238457 25402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:33.251470 25402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40481
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:33.253031 25402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:33.254573 25402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:33.268800 25408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:33.268772 25411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:33.268692 25414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:33.270653 25402 server_base.cc:1034] running on GCE node
I20260812 11:17:33.271560 25402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:33.273145 25402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:33.274417 25402 hybrid_clock.cc:648] HybridClock initialized: now 1786533453274331 us; error 61 us; skew 500 ppm
I20260812 11:17:33.274930 25402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:33 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533453, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:33.279141 25402 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:33.281243 25402 webserver.cc:460] Webserver started at http://127.15.164.254:40747/ using document root <none> and password file <none>
I20260812 11:17:33.282083 25402 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:33.282234 25402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:33.282678 25402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:33.286652 25402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "36462d2811e6440fb962ab6069191788"
format_stamp: "Formatted at 2026-08-12 11:17:33 on dist-test-slave-7kzw"
server_key: "d1d290bf061a6ed365f21f4cec67c8ac"
server_key_iv: "8aa6c44937ec6537aef61e9df2275d97"
server_key_version: "encryptionkey@0"
I20260812 11:17:33.287635 25402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "36462d2811e6440fb962ab6069191788"
format_stamp: "Formatted at 2026-08-12 11:17:33 on dist-test-slave-7kzw"
server_key: "d1d290bf061a6ed365f21f4cec67c8ac"
server_key_iv: "8aa6c44937ec6537aef61e9df2275d97"
server_key_version: "encryptionkey@0"
I20260812 11:17:33.293334 25402 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:17:33.297319 25425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:33.298961 25402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:33.299170 25402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "36462d2811e6440fb962ab6069191788"
format_stamp: "Formatted at 2026-08-12 11:17:33 on dist-test-slave-7kzw"
server_key: "d1d290bf061a6ed365f21f4cec67c8ac"
server_key_iv: "8aa6c44937ec6537aef61e9df2275d97"
server_key_version: "encryptionkey@0"
I20260812 11:17:33.299399 25402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:33.316689 25402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:33.324738 25402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:33.325090 25402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:33.347918 25402 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40481
I20260812 11:17:33.347965 25509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40481 every 8 connection(s)
I20260812 11:17:33.349515 25402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:33.354033 25511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:33.359138 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25402
I20260812 11:17:33.359454 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:33.360378 16019 external_mini_cluster.cc:1428] Setting key fbf8ba952c3044f94fd83566c64de286
I20260812 11:17:33.368849 25511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788: Bootstrap starting.
I20260812 11:17:33.373376 25511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:33.374701 25511 log.cc:824] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:17:33 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:33.379366 25511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788: No bootstrap required, opened a new log
I20260812 11:17:33.388042 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:33.363019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.15.164.254:40481)
0812 11:17:33.363992 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:33.364013 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:33.364072 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:17:33.366905 (+ 2833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:33.366943 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:33.367565 (+ 622us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:33.368091 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:33.369694 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:33.372171 (+ 2477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:33.373716 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:33.374585 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:33.374836 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:33.379642 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:33.379676 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:33.379712 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:33.379766 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:33.383245 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:33.384047 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:33.384055 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:33.384062 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:33.384244 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:33.384670 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:33.384675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:33.384689 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:33.385333 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:33.385846 (+ 513us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:33.386366 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 11:17:33.386880 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":431,"threads_started":1}
I20260812 11:17:33.389236 25511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } }
I20260812 11:17:33.389755 25511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:33.389900 25511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36462d2811e6440fb962ab6069191788, State: Initialized, Role: FOLLOWER
I20260812 11:17:33.390710 25511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } }
I20260812 11:17:33.391053 25511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:33.391237 25511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:33.391467 25511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:33.394300 25511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } }
I20260812 11:17:33.395179 25511 leader_election.cc:302] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36462d2811e6440fb962ab6069191788; no voters:
I20260812 11:17:33.396008 25511 leader_election.cc:288] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:33.396136 25519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:33.396942 25519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [term 1 LEADER]: Becoming Leader. State: Replica: 36462d2811e6440fb962ab6069191788, State: Running, Role: LEADER
I20260812 11:17:33.397625 25519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } }
I20260812 11:17:33.398707 25511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:33.400815 25521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36462d2811e6440fb962ab6069191788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } } }
I20260812 11:17:33.401228 25521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:33.402719 25522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36462d2811e6440fb962ab6069191788. Latest consensus state: current_term: 1 leader_uuid: "36462d2811e6440fb962ab6069191788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36462d2811e6440fb962ab6069191788" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40481 } } }
I20260812 11:17:33.403205 25522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:33.407994 25530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:33.413561 25530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:33.424422 25530 catalog_manager.cc:1347] Generated new cluster ID: 4c49706c52264cbe9ac746ae1836d46b
I20260812 11:17:33.424580 25530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:33.450022 25530 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:33.451900 25530 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:33.461062 25530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36462d2811e6440fb962ab6069191788: Generated new TSK 0
I20260812 11:17:33.462579 25530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:33.546095 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:33.969887 25553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:33.970228 25553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:33.970394 25553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:33.978361 25553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:33.978586 25553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:33.978718 25553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:33.990248 25553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:33.992096 25553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:33.993681 25553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:34.013700 25559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:34.013649 25561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:34.013381 25564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:34.015452 25553 server_base.cc:1034] running on GCE node
I20260812 11:17:34.016283 25553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:34.017514 25553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:34.021128 25553 hybrid_clock.cc:648] HybridClock initialized: now 1786533454020886 us; error 143 us; skew 500 ppm
I20260812 11:17:34.021684 25553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:34 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533454, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:34.026628 25553 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:34.028635 25553 webserver.cc:460] Webserver started at http://127.15.164.193:33981/ using document root <none> and password file <none>
I20260812 11:17:34.029781 25553 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:34.029982 25553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:34.030403 25553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:34.033998 25553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "8c8e1ff31e8747399eb1083c52f67115"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "ed9f52b14846fdaceaf2ac8e6e6efeac"
server_key_iv: "9bc8bcce5ac7e666eae9e23cec612288"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.035020 25553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "8c8e1ff31e8747399eb1083c52f67115"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "ed9f52b14846fdaceaf2ac8e6e6efeac"
server_key_iv: "9bc8bcce5ac7e666eae9e23cec612288"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.042413 25553 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260812 11:17:34.049009 25573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.051178 25553 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:17:34.051424 25553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "8c8e1ff31e8747399eb1083c52f67115"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "ed9f52b14846fdaceaf2ac8e6e6efeac"
server_key_iv: "9bc8bcce5ac7e666eae9e23cec612288"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.051693 25553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:34.072461 25553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:34.077824 25553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:34.078168 25553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:34.079485 25553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:34.081292 25553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:34.081405 25553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.081565 25553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:34.081640 25553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.124842 25553 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:42939
I20260812 11:17:34.124974 25768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:42939 every 8 connection(s)
I20260812 11:17:34.126730 25553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:34.129927 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25553
I20260812 11:17:34.130369 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:34.131350 16019 external_mini_cluster.cc:1428] Setting key c7b5789b626cd786c0d886a44444d486
Aug 12 11:17:34 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533454, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:34.151654 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:34.129865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:48953 (local address 127.15.164.254:40481)
0812 11:17:34.132761 (+ 2896us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:34.132767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:34.132787 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:34.134188 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:34.134194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:34.134326 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:34.134491 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:34.136315 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.137583 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.139441 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.140185 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.140348 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:34.144351 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:34.144357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:34.144361 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:34.144397 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:34.147744 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:34.148718 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:34.148724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:34.148727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:34.148873 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:34.149422 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:34.149428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:34.149430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:34.149774 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:34.149978 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:34.150930 (+ 952us) server_negotiation.cc:299] Negotiation successful
0812 11:17:34.151226 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2776,"thread_start_us":2656,"threads_started":1}
I20260812 11:17:34.152819 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:34.130710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40481 (local address 127.15.164.193:48953)
0812 11:17:34.131887 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:34.131953 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:34.133836 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:34.134832 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:34.134841 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:34.135422 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:34.136077 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:34.136098 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.137833 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.137838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:34.139264 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:34.139279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.140455 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.140461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:34.140751 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:34.141555 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:34.141581 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:34.144059 (+ 2478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:34.147949 (+ 3890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:34.147962 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:34.147985 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:34.148530 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:34.149013 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:34.149018 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:34.149022 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:34.149268 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:34.149935 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:34.149947 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:34.150384 (+ 437us) client_negotiation.cc:769] Sending connection context
0812 11:17:34.150798 (+ 414us) client_negotiation.cc:240] Negotiation successful
0812 11:17:34.151431 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":442,"threads_started":1}
I20260812 11:17:34.154848 25770 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40481
I20260812 11:17:34.155218 25770 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:34.156101 25770 heartbeater.cc:511] Master 127.15.164.254:40481 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:17:34.159130 25457 ts_manager.cc:194] Registered new tserver with Master: 8c8e1ff31e8747399eb1083c52f67115 (127.15.164.193:42939)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
I20260812 11:17:34.161067 25457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:48953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:34.195196 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:34.566937 25781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:34.567323 25781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:34.567498 25781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:34.577068 25781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:34.577237 25781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:34.577456 25781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:34.588423 25781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:34.590622 25781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:34.592135 25781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:34.607353 25787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:34.607677 25788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:34.607728 25792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:34.609537 25781 server_base.cc:1034] running on GCE node
I20260812 11:17:34.610363 25781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:34.611689 25781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:34.613094 25781 hybrid_clock.cc:648] HybridClock initialized: now 1786533454612957 us; error 73 us; skew 500 ppm
I20260812 11:17:34.613770 25781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:34 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533454, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:34.628568 25781 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:34.630524 25781 webserver.cc:460] Webserver started at http://127.15.164.194:38153/ using document root <none> and password file <none>
I20260812 11:17:34.631379 25781 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:34.631551 25781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:34.631938 25781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:34.635365 25781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "e0fddb7487584e91a818d4f18dca8f0b"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "2bb697d90eecde5a2aacc77f9180e410"
server_key_iv: "57f6d4ee32bd16bd116f68514623122c"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.636253 25781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "e0fddb7487584e91a818d4f18dca8f0b"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "2bb697d90eecde5a2aacc77f9180e410"
server_key_iv: "57f6d4ee32bd16bd116f68514623122c"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.642280 25781 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:17:34.646842 25802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.648681 25781 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:17:34.648928 25781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "e0fddb7487584e91a818d4f18dca8f0b"
format_stamp: "Formatted at 2026-08-12 11:17:34 on dist-test-slave-7kzw"
server_key: "2bb697d90eecde5a2aacc77f9180e410"
server_key_iv: "57f6d4ee32bd16bd116f68514623122c"
server_key_version: "encryptionkey@0"
I20260812 11:17:34.649400 25781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:34.668226 25781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:34.673292 25781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:34.673633 25781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:34.674830 25781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:34.676339 25781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:34.676450 25781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.676620 25781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:34.676702 25781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:34.717749 25781 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:36741
I20260812 11:17:34.717768 25978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:36741 every 8 connection(s)
I20260812 11:17:34.719187 25781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:34.724653 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25781
I20260812 11:17:34.724856 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:34.725335 16019 external_mini_cluster.cc:1428] Setting key 019cbdf324c6f4700086ed55bbaace3a
Aug 12 11:17:34 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533454, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:34.745716 25982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:34.721925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:46025 (local address 127.15.164.254:40481)
0812 11:17:34.722420 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:34.722424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:34.723389 (+ 965us) server_negotiation.cc:407] Connection header received
0812 11:17:34.725436 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:34.725442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:34.725537 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:34.725680 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:34.727589 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.728317 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.730958 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.731424 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.731536 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:34.736202 (+ 4666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:34.736212 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:34.736220 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:34.736274 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:34.740873 (+ 4599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:34.742268 (+ 1395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:34.742273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:34.742275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:34.742682 (+ 407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:34.743419 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:34.743424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:34.743427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:34.743902 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:34.744039 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:34.745191 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0812 11:17:34.745402 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":273,"threads_started":1}
I20260812 11:17:34.747556 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:34.722347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40481 (local address 127.15.164.194:46025)
0812 11:17:34.723210 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:34.723263 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:34.725157 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:34.725955 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:34.725968 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:34.726645 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:34.727351 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:34.727381 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.728490 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.728498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:34.730781 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:34.730800 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:34.731674 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:34.731686 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:34.732059 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:34.732933 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:34.732971 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:34.735876 (+ 2905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:34.741117 (+ 5241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:34.741132 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:34.741160 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:34.742068 (+ 908us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:34.742872 (+ 804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:34.742881 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:34.742888 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:34.743231 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:34.744063 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:34.744076 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:34.744683 (+ 607us) client_negotiation.cc:769] Sending connection context
0812 11:17:34.745032 (+ 349us) client_negotiation.cc:240] Negotiation successful
0812 11:17:34.745698 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":299,"threads_started":1}
I20260812 11:17:34.749563 25979 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40481
I20260812 11:17:34.749953 25979 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:34.750833 25979 heartbeater.cc:511] Master 127.15.164.254:40481 requested a full tablet report, sending...
I20260812 11:17:34.752539 25457 ts_manager.cc:194] Registered new tserver with Master: e0fddb7487584e91a818d4f18dca8f0b (127.15.164.194:36741)
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
I20260812 11:17:34.753566 25457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:46025
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:34.790827 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:35.165196 25770 heartbeater.cc:503] Master 127.15.164.254:40481 was elected leader, sending a full tablet report...
W20260812 11:17:35.192529 25988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:35.192884 25988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:35.193055 25988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:35.201278 25988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:35.201423 25988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:35.201602 25988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:35.213610 25988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:35.215219 25988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:35.216753 25988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:35.232347 25994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:35.232230 25998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:35.232230 25996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:35.234805 25988 server_base.cc:1034] running on GCE node
I20260812 11:17:35.235805 25988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:35.237083 25988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:35.240523 25988 hybrid_clock.cc:648] HybridClock initialized: now 1786533455240429 us; error 68 us; skew 500 ppm
I20260812 11:17:35.240967 25988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.245194 25988 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:17:35.247190 25988 webserver.cc:460] Webserver started at http://127.15.164.195:44369/ using document root <none> and password file <none>
I20260812 11:17:35.248029 25988 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:35.248198 25988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:35.248579 25988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:35.252427 25988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "723a70fafb7941908d80d427b49db7f0"
format_stamp: "Formatted at 2026-08-12 11:17:35 on dist-test-slave-7kzw"
server_key: "0deaf154634c15e4ce9a5937061ae7e4"
server_key_iv: "68ba2c34bfc2f4536a0098aa7a855262"
server_key_version: "encryptionkey@0"
I20260812 11:17:35.253571 25988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "723a70fafb7941908d80d427b49db7f0"
format_stamp: "Formatted at 2026-08-12 11:17:35 on dist-test-slave-7kzw"
server_key: "0deaf154634c15e4ce9a5937061ae7e4"
server_key_iv: "68ba2c34bfc2f4536a0098aa7a855262"
server_key_version: "encryptionkey@0"
I20260812 11:17:35.260901 25988 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260812 11:17:35.265470 26010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:35.268006 25988 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:17:35.268251 25988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "723a70fafb7941908d80d427b49db7f0"
format_stamp: "Formatted at 2026-08-12 11:17:35 on dist-test-slave-7kzw"
server_key: "0deaf154634c15e4ce9a5937061ae7e4"
server_key_iv: "68ba2c34bfc2f4536a0098aa7a855262"
server_key_version: "encryptionkey@0"
I20260812 11:17:35.268507 25988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:35.287279 25988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:35.292135 25988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:35.292495 25988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:35.293619 25988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:35.295275 25988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:35.295387 25988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:35.295547 25988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:35.295627 25988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:35.339318 25988 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:33083
I20260812 11:17:35.339332 26193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:33083 every 8 connection(s)
I20260812 11:17:35.340898 25988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:35.349773 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 25988
I20260812 11:17:35.349965 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:35.350849 16019 external_mini_cluster.cc:1428] Setting key 27c0db7e49663fcee4b0731d2c30cdce
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:35.368167 26201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.344737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:46053 (local address 127.15.164.254:40481)
0812 11:17:35.345285 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.345290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.346535 (+ 1245us) server_negotiation.cc:407] Connection header received
0812 11:17:35.348614 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.348619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.348717 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.348861 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.350724 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.351799 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.353983 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.354793 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.354928 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.359704 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.359710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.359714 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.359752 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.363143 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.364061 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.364066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.364101 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.364256 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.365158 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.365162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.365164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.365624 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.365881 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.367243 (+ 1362us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.367544 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":283,"threads_started":1}
I20260812 11:17:35.368980 26203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.345295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40481 (local address 127.15.164.195:46053)
0812 11:17:35.346239 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:35.346282 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:35.348286 (+ 2004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:35.349135 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:35.349144 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:35.349714 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:35.350447 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:35.350525 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.352003 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.352011 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:35.353795 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:35.353811 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.355038 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.355048 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:35.355351 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.356224 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:35.356256 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:35.359398 (+ 3142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:35.363351 (+ 3953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:35.363360 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:35.363376 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:35.363864 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:35.364422 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:35.364427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:35.364429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:35.364980 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:35.365897 (+ 917us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:35.365907 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:35.366594 (+ 687us) client_negotiation.cc:769] Sending connection context
0812 11:17:35.366986 (+ 392us) client_negotiation.cc:240] Negotiation successful
0812 11:17:35.367611 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":471,"threads_started":1}
I20260812 11:17:35.371594 26194 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40481
I20260812 11:17:35.372004 26194 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:35.373011 26194 heartbeater.cc:511] Master 127.15.164.254:40481 requested a full tablet report, sending...
I20260812 11:17:35.375164 25457 ts_manager.cc:194] Registered new tserver with Master: 723a70fafb7941908d80d427b49db7f0 (127.15.164.195:33083)
I20260812 11:17:35.376197 25457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:46053
I20260812 11:17:35.382618 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/test-admin.keytab.
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.423923 16019 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 11:17:35.430925 26208 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:35.427581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32936 (local address 127.15.164.193:42939)
0812 11:17:35.428424 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.428432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.428475 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:17:35.428541 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.428548 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.428787 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.428974 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.430266 (+ 1292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32936: BlockingRecv error: recv got EOF from 127.0.0.1:32936 (error 108)
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":548,"threads_started":1}
W20260812 11:17:35.431021 16019 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.433199 16019 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.435081 16019 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:35.454850 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.437431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.15.164.193:42939)
0812 11:17:35.437714 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.437721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.437979 (+ 258us) server_negotiation.cc:407] Connection header received
0812 11:17:35.438223 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.438228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.438296 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.438406 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.439634 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.440645 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.441985 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.442699 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.442851 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.447280 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.447296 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.447314 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.447359 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.450689 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.451669 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.451678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.451681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.451834 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.452344 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.452349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.452351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.452792 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.453051 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.453899 (+ 848us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.454441 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260812 11:17:35.462649 16019 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc' of type FILE
W20260812 11:17:35.462666 26208 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:35.460234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.15.164.193:42939)
0812 11:17:35.460470 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.460479 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.460652 (+ 173us) server_negotiation.cc:407] Connection header received
0812 11:17:35.460830 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.460834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.460914 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.461000 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.462069 (+ 1069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32956: BlockingRecv error: recv got EOF from 127.0.0.1:32956 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.464970 16019 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.466684 16019 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:35.487074 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.468678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32958 (local address 127.15.164.193:42939)
0812 11:17:35.468914 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.468921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.469248 (+ 327us) server_negotiation.cc:407] Connection header received
0812 11:17:35.469379 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.469384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.469488 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.469645 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.471177 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.472022 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.473653 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.474280 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.474515 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.479529 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.479538 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.479543 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.479612 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.483644 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.484565 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.484581 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.484583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.484739 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.485232 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.485236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.485238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.485561 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.485780 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.486413 (+ 633us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.486743 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 11:17:35.493789 26208 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:35.491292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32966 (local address 127.15.164.193:42939)
0812 11:17:35.491602 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.491610 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.492210 (+ 600us) server_negotiation.cc:407] Connection header received
0812 11:17:35.492446 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.492450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.492532 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.492649 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.493463 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32966: BlockingRecv error: recv got EOF from 127.0.0.1:32966 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 11:17:35.494036 16019 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786533397360424-16019-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.495790 16019 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:35.497205 16019 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:17:35.516834 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.499182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32968 (local address 127.15.164.193:42939)
0812 11:17:35.499431 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.499438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.499682 (+ 244us) server_negotiation.cc:407] Connection header received
0812 11:17:35.499896 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.499906 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.499969 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.500078 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.501216 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.501958 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.503346 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.503884 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.504029 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.510204 (+ 6175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.510210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.510214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.510265 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.513673 (+ 3408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.514708 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.514713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.514715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.514888 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.515361 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.515366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.515368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.515738 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.515972 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.516339 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.516522 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:17:35.519161 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25553
I20260812 11:17:35.535861 26208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.520233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.15.164.193:42939)
0812 11:17:35.520440 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.520445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.520630 (+ 185us) server_negotiation.cc:407] Connection header received
0812 11:17:35.520811 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.520815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.521199 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.521298 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.522788 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.523652 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.524993 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.525437 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.525551 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.528420 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.528425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.528429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.528467 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.531526 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.532765 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.532770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.532772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.533109 (+ 337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.534119 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.534124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.534126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.534459 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.534781 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.535247 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.535558 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:17:35.536651 25763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:35.631527 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25553
I20260812 11:17:35.661799 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25781
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:17:35.683934 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.662963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39608 (local address 127.15.164.194:36741)
0812 11:17:35.663652 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.663667 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.663695 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:17:35.663765 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.663771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.663993 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.664120 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.665755 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.667343 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.669554 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.670646 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.670824 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.676404 (+ 5580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.676450 (+ 46us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.676482 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.676560 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.680413 (+ 3853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.681365 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.681375 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.681377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.681533 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.682050 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.682063 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.682066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.682653 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.683028 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.683354 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.683586 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":388,"threads_started":1}
I20260812 11:17:35.685662 25969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:35.773424 25979 heartbeater.cc:503] Master 127.15.164.254:40481 was elected leader, sending a full tablet report...
I20260812 11:17:35.775302 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25781
I20260812 11:17:35.800719 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25988
Aug 12 11:17:35 dist-test-slave-7kzw krb5kdc[25378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:17:35.820359 26234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:35.801893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48234 (local address 127.15.164.195:33083)
0812 11:17:35.802603 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:35.802612 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:35.802645 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:17:35.802710 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:35.802717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:35.802947 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:35.803144 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:35.804371 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.805549 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.807317 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:35.808091 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:35.808245 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:35.813566 (+ 5321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:35.813586 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:35.813613 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:35.813659 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:35.817163 (+ 3504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.818044 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.818054 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.818056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.818219 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:35.818755 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:35.818759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:35.818762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:35.819222 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:35.819524 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:35.819807 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 11:17:35.820039 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":340,"threads_started":1}
I20260812 11:17:35.822144 26186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:35.917375 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25988
I20260812 11:17:35.950003 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 25402
I20260812 11:17:35.951450 25505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:36.075713 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 25402
2026-08-12T11:17:36Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (5006 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:36 dist-test-slave-7kzw krb5kdc[26247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:36 dist-test-slave-7kzw krb5kdc[26247](info): set up 2 sockets
Aug 12 11:17:36 dist-test-slave-7kzw krb5kdc[26247](info): commencing operation
krb5kdc: starting...
W20260812 11:17:37.516894 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.383s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:37 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:37Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab.
Entry for principal oryx/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab.
I20260812 11:17:37.798696 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39501
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab
--principal=oryx/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:39501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:38.187580 26266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:38.188022 26266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:38.188191 26266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:38.195894 26266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:38.196076 26266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:38.196183 26266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:38.196298 26266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:38.196382 26266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:38.206854 26266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:39501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab
--principal=oryx/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:38.208482 26266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:38.209933 26266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:38.223003 26272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:38.222923 26278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:38.222973 26273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:38.224040 26266 server_base.cc:1034] running on GCE node
I20260812 11:17:38.224920 26266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:38.226558 26266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:38.227982 26266 hybrid_clock.cc:648] HybridClock initialized: now 1786533458227921 us; error 43 us; skew 500 ppm
I20260812 11:17:38.228444 26266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:38 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533458, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:38.232180 26266 init.cc:377] Logged in from keytab as oryx/127.15.164.254@KRBTEST.COM (short username oryx)
I20260812 11:17:38.233932 26266 webserver.cc:460] Webserver started at http://127.15.164.254:41011/ using document root <none> and password file <none>
I20260812 11:17:38.234763 26266 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:38.234879 26266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:38.235144 26266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:38.239055 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "31479e69a16d48c7a0da920ac3fa5262"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "45ef9d60542939cef2128419c01bcf52"
server_key_iv: "1e52776323fdff32810858e0a6219871"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.240029 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "31479e69a16d48c7a0da920ac3fa5262"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "45ef9d60542939cef2128419c01bcf52"
server_key_iv: "1e52776323fdff32810858e0a6219871"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.246001 26266 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:17:38.250967 26291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:38.252938 26266 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:17:38.253211 26266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "31479e69a16d48c7a0da920ac3fa5262"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "45ef9d60542939cef2128419c01bcf52"
server_key_iv: "1e52776323fdff32810858e0a6219871"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.253419 26266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:38.273003 26266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:38.278218 26266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:38.278610 26266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:38.300454 26266 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:39501
I20260812 11:17:38.300706 26361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:39501 every 8 connection(s)
I20260812 11:17:38.301990 26266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:38.306134 26364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:38.308274 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 26266
I20260812 11:17:38.308523 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:38.309636 16019 external_mini_cluster.cc:1428] Setting key 6fc5b74a7e0313e4d838ae33ea31e578
I20260812 11:17:38.320720 26364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Bootstrap starting.
I20260812 11:17:38.325551 26364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:38.327216 26364 log.cc:824] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:17:38 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:38.331779 26364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: No bootstrap required, opened a new log
I20260812 11:17:38.340402 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:38.312669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43546 (local address 127.15.164.254:39501)
0812 11:17:38.313899 (+ 1230us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:38.313912 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:38.313958 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:17:38.315742 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:38.315767 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:38.316186 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:38.316533 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:38.318641 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:38.320175 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:38.322025 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:38.323009 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:38.323163 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:38.329294 (+ 6131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:38.329307 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:38.329330 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:38.329385 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:38.334063 (+ 4678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:38.335054 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:38.335066 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:38.335081 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:38.335355 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:38.335838 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:38.335844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:38.335848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:38.336884 (+ 1036us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:38.337319 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:38.337826 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 11:17:38.338368 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":966,"thread_start_us":668,"threads_started":1}
I20260812 11:17:38.344805 26364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } }
I20260812 11:17:38.345240 26364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:38.345376 26364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31479e69a16d48c7a0da920ac3fa5262, State: Initialized, Role: FOLLOWER
I20260812 11:17:38.346235 26364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } }
I20260812 11:17:38.346516 26364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:38.346699 26364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:38.346900 26364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:38.349345 26364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } }
I20260812 11:17:38.349979 26364 leader_election.cc:302] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31479e69a16d48c7a0da920ac3fa5262; no voters:
I20260812 11:17:38.351033 26364 leader_election.cc:288] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:38.351248 26375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:38.352373 26375 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 LEADER]: Becoming Leader. State: Replica: 31479e69a16d48c7a0da920ac3fa5262, State: Running, Role: LEADER
I20260812 11:17:38.352962 26375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } }
I20260812 11:17:38.353717 26364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:38.356401 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } }
I20260812 11:17:38.356983 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:38.358126 26377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31479e69a16d48c7a0da920ac3fa5262. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } }
I20260812 11:17:38.358639 26377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:38.365126 26389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:38.369916 26389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:38.380378 26389 catalog_manager.cc:1347] Generated new cluster ID: a5b6c07957d04f38b104b4bf378c1b55
I20260812 11:17:38.380524 26389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:38.398819 26389 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:38.400410 26389 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:38.418946 26389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Generated new TSK 0
I20260812 11:17:38.420035 26389 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
I20260812 11:17:38.496410 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:38.883996 26416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:38.884320 26416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:38.884479 26416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:38.892177 26416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:38.892315 26416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:38.892500 26416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:38.904374 26416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:38.906342 26416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:38.908078 26416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:38.924026 26427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:38.923936 26425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:38.923964 26424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:38.929504 26416 server_base.cc:1034] running on GCE node
I20260812 11:17:38.930588 26416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:38.931883 26416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:38.933409 26416 hybrid_clock.cc:648] HybridClock initialized: now 1786533458933327 us; error 60 us; skew 500 ppm
I20260812 11:17:38.933761 26416 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:38 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533458, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:38.938020 26416 init.cc:377] Logged in from keytab as oryx/127.15.164.193@KRBTEST.COM (short username oryx)
I20260812 11:17:38.939934 26416 webserver.cc:460] Webserver started at http://127.15.164.193:38847/ using document root <none> and password file <none>
I20260812 11:17:38.940764 26416 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:38.940938 26416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:38.941293 26416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:38.944734 26416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "8a7428ac391d4ecf923862889b8c0c4f"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "ee1f7e244db2535649870e4ea1e7589d"
server_key_iv: "e446f56609514c7e8dc595c4512f8dca"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.945636 26416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "8a7428ac391d4ecf923862889b8c0c4f"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "ee1f7e244db2535649870e4ea1e7589d"
server_key_iv: "e446f56609514c7e8dc595c4512f8dca"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.952258 26416 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:17:38.957052 26435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:38.960029 26416 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260812 11:17:38.960459 26416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "8a7428ac391d4ecf923862889b8c0c4f"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "ee1f7e244db2535649870e4ea1e7589d"
server_key_iv: "e446f56609514c7e8dc595c4512f8dca"
server_key_version: "encryptionkey@0"
I20260812 11:17:38.960747 26416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:39.004518 26416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:39.010324 26416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:39.010779 26416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:39.011891 26416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:39.013430 26416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:39.013541 26416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:39.013703 26416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:39.013789 26416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:39.056270 26416 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:42397
I20260812 11:17:39.056317 26604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:42397 every 8 connection(s)
I20260812 11:17:39.057945 26416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:39.067958 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 26416
I20260812 11:17:39.068197 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:39.068846 16019 external_mini_cluster.cc:1428] Setting key c435540e6798797c63ad24648bcd72b7
Aug 12 11:17:39 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533458, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:39.083294 26610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:39.062061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:39531 (local address 127.15.164.254:39501)
0812 11:17:39.062597 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:39.062602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:39.063529 (+ 927us) server_negotiation.cc:407] Connection header received
0812 11:17:39.065491 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:39.065496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:39.065592 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:39.065713 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:39.067471 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.068264 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.070193 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.070761 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.070898 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:39.075289 (+ 4391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:39.075299 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:39.075307 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:39.075359 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:39.079347 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:39.080314 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:39.080322 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:39.080328 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:39.080495 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:39.081173 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:39.081177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:39.081179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:39.081487 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:39.081623 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:39.082733 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0812 11:17:39.082936 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":290,"threads_started":1}
I20260812 11:17:39.084827 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:39.062615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:39531)
0812 11:17:39.063361 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:39.063399 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:39.065209 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:39.065991 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:39.066000 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:39.066648 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:39.067244 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:39.067280 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.068458 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.068462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:39.069988 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:39.070006 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.071023 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.071033 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:39.071253 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:39.072060 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:39.072085 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:39.075028 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:39.079545 (+ 4517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:39.079554 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:39.079572 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:39.080094 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:39.080629 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:39.080636 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:39.080641 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:39.080988 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:39.081652 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:39.081663 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:39.082208 (+ 545us) client_negotiation.cc:769] Sending connection context
0812 11:17:39.082576 (+ 368us) client_negotiation.cc:240] Negotiation successful
0812 11:17:39.083220 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":285,"threads_started":1}
I20260812 11:17:39.086717 26605 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:39.087083 26605 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:39.087973 26605 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:39.090379 26316 ts_manager.cc:194] Registered new tserver with Master: 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:39.092188 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:39531
WARNING: no policy specified for oryx/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
I20260812 11:17:39.130721 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:39.510630 26615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:39.511075 26615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:39.511265 26615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:39.520779 26615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:39.520994 26615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:39.521206 26615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:39.533996 26615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:39.535629 26615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:39.537190 26615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:39.552452 26623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:39.552445 26624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:39.552763 26628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:39.553568 26615 server_base.cc:1034] running on GCE node
I20260812 11:17:39.554376 26615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:39.555797 26615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:39.557119 26615 hybrid_clock.cc:648] HybridClock initialized: now 1786533459557071 us; error 41 us; skew 500 ppm
I20260812 11:17:39.557600 26615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:39 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533459, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:39.563030 26615 init.cc:377] Logged in from keytab as oryx/127.15.164.194@KRBTEST.COM (short username oryx)
I20260812 11:17:39.565143 26615 webserver.cc:460] Webserver started at http://127.15.164.194:36135/ using document root <none> and password file <none>
I20260812 11:17:39.565976 26615 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:39.566095 26615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:39.566367 26615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:39.570195 26615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "4301cfc3431a4d6ab30c5379c4236ba1"
format_stamp: "Formatted at 2026-08-12 11:17:39 on dist-test-slave-7kzw"
server_key: "334e2f14f41dbdc81c56149de39c7b90"
server_key_iv: "e4506b35284114e604d1ccbcdcddd7b7"
server_key_version: "encryptionkey@0"
I20260812 11:17:39.571168 26615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "4301cfc3431a4d6ab30c5379c4236ba1"
format_stamp: "Formatted at 2026-08-12 11:17:39 on dist-test-slave-7kzw"
server_key: "334e2f14f41dbdc81c56149de39c7b90"
server_key_iv: "e4506b35284114e604d1ccbcdcddd7b7"
server_key_version: "encryptionkey@0"
I20260812 11:17:39.577416 26615 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:17:39.582401 26643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:39.584767 26615 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260812 11:17:39.584954 26615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "4301cfc3431a4d6ab30c5379c4236ba1"
format_stamp: "Formatted at 2026-08-12 11:17:39 on dist-test-slave-7kzw"
server_key: "334e2f14f41dbdc81c56149de39c7b90"
server_key_iv: "e4506b35284114e604d1ccbcdcddd7b7"
server_key_version: "encryptionkey@0"
I20260812 11:17:39.585180 26615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:39.611459 26615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:39.617027 26615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:39.617322 26615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:39.618381 26615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:39.620082 26615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:39.620191 26615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:39.620321 26615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:39.620375 26615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:39.661753 26615 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:41295
I20260812 11:17:39.661799 26822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:41295 every 8 connection(s)
I20260812 11:17:39.664047 26615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:39.670185 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 26615
I20260812 11:17:39.670382 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:39.671013 16019 external_mini_cluster.cc:1428] Setting key 1964053ede3797e2367c3eb7c9b651ba
Aug 12 11:17:39 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533459, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:39.692291 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:39.668147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:38933 (local address 127.15.164.254:39501)
0812 11:17:39.668762 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:39.668770 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:39.671392 (+ 2622us) server_negotiation.cc:407] Connection header received
0812 11:17:39.672646 (+ 1254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:39.672655 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:39.672783 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:39.672926 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:39.675187 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.675913 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.678662 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.679120 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.679236 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:39.684327 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:39.684336 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:39.684343 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:39.684394 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:39.687505 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:39.688682 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:39.688691 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:39.688696 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:39.689019 (+ 323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:39.689697 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:39.689701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:39.689704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:39.690056 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:39.690329 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:39.691541 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0812 11:17:39.691844 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":297,"threads_started":1}
I20260812 11:17:39.693542 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:39.668887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:38933)
0812 11:17:39.669851 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:39.669916 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:39.672259 (+ 2343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:39.673217 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:39.673226 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:39.673955 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:39.674887 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:39.674919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.676099 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.676107 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:39.678398 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:39.678420 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:39.679410 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:39.679421 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:39.679796 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:39.680779 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:39.680818 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:39.684004 (+ 3186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:39.687710 (+ 3706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:39.687724 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:39.687750 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:39.688470 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:39.689223 (+ 753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:39.689231 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:39.689237 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:39.689520 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:39.690293 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:39.690305 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:39.690855 (+ 550us) client_negotiation.cc:769] Sending connection context
0812 11:17:39.691199 (+ 344us) client_negotiation.cc:240] Negotiation successful
0812 11:17:39.691885 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":353,"threads_started":1}
I20260812 11:17:39.695533 26824 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:39.695916 26824 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:39.696743 26824 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:39.698832 26316 ts_manager.cc:194] Registered new tserver with Master: 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295)
I20260812 11:17:39.700145 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:38933
WARNING: no policy specified for oryx/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
I20260812 11:17:39.739585 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:40.095618 26605 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
W20260812 11:17:40.130038 26834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:40.130411 26834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:40.130620 26834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:40.139833 26834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:40.140054 26834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:40.140363 26834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:40.151146 26834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:40.152843 26834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:40.154456 26834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:40.169868 26848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:40.169895 26847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:40.169813 26850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:40.171077 26834 server_base.cc:1034] running on GCE node
I20260812 11:17:40.171860 26834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:40.173018 26834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:40.174320 26834 hybrid_clock.cc:648] HybridClock initialized: now 1786533460174239 us; error 64 us; skew 500 ppm
I20260812 11:17:40.174919 26834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533460, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:40.179834 26834 init.cc:377] Logged in from keytab as oryx/127.15.164.195@KRBTEST.COM (short username oryx)
I20260812 11:17:40.182070 26834 webserver.cc:460] Webserver started at http://127.15.164.195:35327/ using document root <none> and password file <none>
I20260812 11:17:40.182981 26834 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:40.183156 26834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:40.183512 26834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:40.186713 26834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "d17e6c3b934d42fc81189e8b10f19221"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "7f02db3cc2182c2646191c19526eef19"
server_key_iv: "236499cfd98f67560e13382be91713d3"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.187604 26834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "d17e6c3b934d42fc81189e8b10f19221"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "7f02db3cc2182c2646191c19526eef19"
server_key_iv: "236499cfd98f67560e13382be91713d3"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.193766 26834 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:17:40.197830 26860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:40.199496 26834 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:40.199704 26834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "d17e6c3b934d42fc81189e8b10f19221"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "7f02db3cc2182c2646191c19526eef19"
server_key_iv: "236499cfd98f67560e13382be91713d3"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.199915 26834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:40.218907 26834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:40.227161 26834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:40.227576 26834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:40.228780 26834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:40.230314 26834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:40.230394 26834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:40.230561 26834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:40.230620 26834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:40.273828 26834 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:43667
I20260812 11:17:40.273878 27027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:43667 every 8 connection(s)
I20260812 11:17:40.275405 26834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:40.280836 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 26834
I20260812 11:17:40.281047 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:40.281538 16019 external_mini_cluster.cc:1428] Setting key 5528f116e832060c6c3336337844c533
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533460, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:40.299139 27033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.279076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:46913 (local address 127.15.164.254:39501)
0812 11:17:40.279600 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.279605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.280795 (+ 1190us) server_negotiation.cc:407] Connection header received
0812 11:17:40.282991 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.282996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.283118 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.283247 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:40.285209 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.285980 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.287691 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.288127 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.288272 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.292369 (+ 4097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:40.292375 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:40.292379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:40.292417 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:40.295464 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.296435 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.296440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.296442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.296592 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.297078 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.297082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.297085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.297449 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:40.297633 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:40.298415 (+ 782us) server_negotiation.cc:299] Negotiation successful
0812 11:17:40.298710 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":261,"threads_started":1}
I20260812 11:17:40.300370 27035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.279745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:46913)
0812 11:17:40.280615 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:40.280656 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:40.282663 (+ 2007us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:40.283519 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:40.283529 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:40.284298 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:40.285033 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.285052 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.286162 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.286166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.287512 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.287525 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.288372 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.288379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.288641 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.289379 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:40.289404 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:40.292115 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:40.295645 (+ 3530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.295653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.295669 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.296291 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.296717 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.296722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.296726 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.296938 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.297606 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:40.297615 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:40.298011 (+ 396us) client_negotiation.cc:769] Sending connection context
0812 11:17:40.298311 (+ 300us) client_negotiation.cc:240] Negotiation successful
0812 11:17:40.298976 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":331,"threads_started":1}
I20260812 11:17:40.302037 27029 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:40.302390 27029 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:40.303249 27029 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:40.304987 26316 ts_manager.cc:194] Registered new tserver with Master: d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667)
I20260812 11:17:40.305969 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:46913
I20260812 11:17:40.311914 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.164.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.253.keytab.
Entry for principal oryx/127.15.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.253.keytab.
I20260812 11:17:40.376474 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:34165
--webserver_interface=127.15.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.253.keytab
--principal=oryx/127.15.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:39501,127.15.164.253:34165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:40.703466 26824 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
W20260812 11:17:40.754021 27039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:40.754374 27039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:40.754580 27039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:40.764315 27039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:40.764446 27039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:40.764526 27039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:40.764614 27039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:40.764655 27039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:40.775542 27039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:39501,127.15.164.253:34165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.253.keytab
--principal=oryx/127.15.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:34165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
W20260812 11:17:40.775998 27039 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.164.254:39501,127.15.164.253:34165'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 11:17:40.777190 27039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:40.778699 27039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:40.791584 27046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:40.791926 27048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:40.791926 27051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:40.793004 27039 server_base.cc:1034] running on GCE node
I20260812 11:17:40.793933 27039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:40.795652 27039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:40.796923 27039 hybrid_clock.cc:648] HybridClock initialized: now 1786533460796823 us; error 59 us; skew 500 ppm
I20260812 11:17:40.797348 27039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533460, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:40.801434 27039 init.cc:377] Logged in from keytab as oryx/127.15.164.253@KRBTEST.COM (short username oryx)
I20260812 11:17:40.803516 27039 webserver.cc:460] Webserver started at http://127.15.164.253:43889/ using document root <none> and password file <none>
I20260812 11:17:40.804502 27039 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:40.804665 27039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:40.805110 27039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:40.808990 27039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/instance:
uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "1a452c3946f862d381686a08397b31c5"
server_key_iv: "52cc345da6d16a31c2aacaee6aef8134"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.809832 27039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal/instance:
uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "1a452c3946f862d381686a08397b31c5"
server_key_iv: "52cc345da6d16a31c2aacaee6aef8134"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.815779 27039 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:17:40.820322 27063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:40.822132 27039 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:17:40.822389 27039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "1a452c3946f862d381686a08397b31c5"
server_key_iv: "52cc345da6d16a31c2aacaee6aef8134"
server_key_version: "encryptionkey@0"
I20260812 11:17:40.822918 27039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:40.858899 27039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:40.864138 27039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:40.864470 27039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:40.886319 27039 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.253:34165
I20260812 11:17:40.886345 27143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.253:34165 every 8 connection(s)
I20260812 11:17:40.887934 27039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
I20260812 11:17:40.892536 27144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:40.894182 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 27039
I20260812 11:17:40.904084 27144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533460, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.253@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:40.923265 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.896942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43780 (local address 127.15.164.253:34165)
0812 11:17:40.897918 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.897931 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.897980 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:17:40.900095 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.900123 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.900569 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.900978 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:40.903265 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.905073 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.907033 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.908160 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.908370 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.913689 (+ 5319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:40.913698 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:40.913715 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:40.913771 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:40.918188 (+ 4417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.919092 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.919100 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.919107 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.919287 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.919734 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.919746 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.919749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.920378 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:40.920720 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:40.921262 (+ 542us) server_negotiation.cc:299] Negotiation successful
0812 11:17:40.921774 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":511,"threads_started":1}
I20260812 11:17:40.926337 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.907333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43558 (local address 127.15.164.254:39501)
0812 11:17:40.909102 (+ 1769us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.909110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.909133 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:17:40.909201 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.909209 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.909300 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.909434 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:40.911359 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.912369 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.913971 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.914530 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.914698 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.919812 (+ 5114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:40.919821 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:40.919825 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:40.919876 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:40.923040 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.923974 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.923981 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.923988 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.924138 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.924555 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.924563 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.924570 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.924990 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:40.925176 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:40.925682 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 11:17:40.925937 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1634,"thread_start_us":1527,"threads_started":1}
I20260812 11:17:40.926417 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.907241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43558)
0812 11:17:40.908160 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:40.908222 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:40.908375 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:40.909521 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:40.909529 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:40.910902 (+ 1373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:40.911183 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.911193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.912611 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.912616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.913799 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.913813 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.914847 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.914856 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.915142 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.915956 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:40.915976 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:40.919352 (+ 3376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:40.923194 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.923207 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.923219 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.923836 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.924271 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.924277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.924281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.924437 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.925134 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:40.925143 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:40.925355 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 11:17:40.925583 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 11:17:40.925936 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":375,"threads_started":1}
I20260812 11:17:40.928823 27144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:17:40 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533460, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.253@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:40.947546 27150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.930965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43792)
0812 11:17:40.931515 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:40.931537 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:40.931744 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:40.932352 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:40.932359 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:40.932857 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:40.933014 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.933025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.934165 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.934171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.935201 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:40.935215 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.936075 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.936082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:40.936293 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.937119 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:40.937139 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:40.939553 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:40.944220 (+ 4667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.944230 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.944233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.944648 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.945140 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:40.945146 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:40.945149 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:40.945287 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:40.945826 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:40.945831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:40.946183 (+ 352us) client_negotiation.cc:769] Sending connection context
0812 11:17:40.946381 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 11:17:40.946803 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325}
I20260812 11:17:40.947652 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.931353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43792 (local address 127.15.164.253:34165)
0812 11:17:40.931516 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.931524 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.931656 (+ 132us) server_negotiation.cc:407] Connection header received
0812 11:17:40.932047 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.932052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.932126 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.932239 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:40.933188 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.933982 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.935365 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:40.935887 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:40.936044 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:40.939773 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:40.939778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:40.939781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:40.939815 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:40.943841 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.944854 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.944860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.944863 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.945013 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:40.945402 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:40.945413 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:40.945416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:40.945697 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:40.945861 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:40.946541 (+ 680us) server_negotiation.cc:299] Negotiation successful
0812 11:17:40.947299 (+ 758us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":184,"server-negotiator.queue_time_us":65}
I20260812 11:17:40.954345 27144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Bootstrap starting.
I20260812 11:17:40.958846 27144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:40.960214 27144 log.cc:824] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:40.963794 27144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: No bootstrap required, opened a new log
I20260812 11:17:40.972600 27144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } }
I20260812 11:17:40.973006 27144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:40.973158 27144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3278bcd67db74c6f9095c6f25bcf03d6, State: Initialized, Role: FOLLOWER
I20260812 11:17:40.973846 27144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } }
I20260812 11:17:40.975005 27157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } }
I20260812 11:17:40.975400 27157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:40.976336 27144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:17:40.988442 27173 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:17:40.988680 27173 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:17:40.991719 27039 master_runner.cc:428] Detected that this master 3278bcd67db74c6f9095c6f25bcf03d6 is joining an existing cluster
I20260812 11:17:40.991855 27039 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.164.253:34165
I20260812 11:17:41.016327 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.996919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.15.164.254:39501)
0812 11:17:40.997122 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.997129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.998286 (+ 1157us) server_negotiation.cc:407] Connection header received
0812 11:17:40.998629 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.998635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.998751 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.998835 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.000624 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.001701 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.004044 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.004740 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.004917 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.007226 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.007233 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.007238 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.007300 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.012287 (+ 4987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.013549 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.013556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.013561 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.013770 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.014247 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.014253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.014257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.014853 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.015174 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.015665 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.015936 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:17:41.016700 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.996592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.15.164.253:34165)
0812 11:17:40.996846 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:40.996853 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:40.998857 (+ 2004us) server_negotiation.cc:407] Connection header received
0812 11:17:40.999040 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:40.999046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:40.999107 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:40.999223 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.000486 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.001700 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.003264 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.004213 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.004342 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.007307 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.007312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.007317 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.007356 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.012335 (+ 4979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.013407 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.013413 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.013417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.013705 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.014264 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.014274 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.014285 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.014797 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.014984 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.015775 (+ 791us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.016094 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":68}
I20260812 11:17:41.017220 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.997380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43794)
0812 11:17:40.998748 (+ 1368us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:40.998768 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:40.998927 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:40.999236 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:40.999240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:40.999924 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.000330 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.000344 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.001937 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.001941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.003121 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.003133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.004498 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.004509 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.004705 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.005565 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.005590 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.007044 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.012515 (+ 5471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.012520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.012523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.013239 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.013862 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.013870 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.013874 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.014107 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.015084 (+ 977us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.015090 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.015451 (+ 361us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.015904 (+ 453us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.016334 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1253,"mutex_wait_us":156,"spinlock_wait_cycles":19072,"thread_start_us":455,"threads_started":1}
I20260812 11:17:41.017832 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:40.996776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43566)
0812 11:17:40.998166 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:40.998190 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:40.998412 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:40.999080 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:40.999084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:40.999977 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.000392 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.000406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.001877 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.001883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.003863 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.003879 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.004958 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.004966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.005201 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.005862 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.005880 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.006973 (+ 1093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.012519 (+ 5546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.012528 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.012533 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.013368 (+ 835us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.013932 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.013936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.013939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.014106 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.015080 (+ 974us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.015086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.015383 (+ 297us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.015546 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.017101 (+ 1555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1233,"mutex_wait_us":32,"spinlock_wait_cycles":66688,"thread_start_us":1613,"threads_started":1}
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533458, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.254@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:41.044000 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.025832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.15.164.253:34165)
0812 11:17:41.026031 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.026036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.027029 (+ 993us) server_negotiation.cc:407] Connection header received
0812 11:17:41.027617 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.027622 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.027958 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.028124 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.029907 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.031247 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.032943 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.033430 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.033583 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.037381 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.037387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.037390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.037426 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.040479 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.041335 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.041342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.041349 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.041510 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.041947 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.041952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.042007 (+ 55us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.042442 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.042706 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.043318 (+ 612us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.043582 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:17:41.044237 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.025891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43802)
0812 11:17:41.026843 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.026887 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.027152 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.028183 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.028192 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.029334 (+ 1142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.029670 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.029685 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.031515 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.031523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.032717 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.032733 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.033620 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.033626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.033862 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.034672 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.034697 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.037138 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.040662 (+ 3524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.040679 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.040688 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.041193 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.041649 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.041654 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.041659 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.041821 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.042675 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.042686 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.042915 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.043174 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.043654 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":366,"threads_started":1}
I20260812 11:17:41.046805 26316 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.164.253:34165: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
member_type: NON_VOTER
last_known_addr {
host: "127.15.164.253"
port: 34165
}
attrs {
promote: true
}
}
dest_uuid: "31479e69a16d48c7a0da920ac3fa5262"
cas_config_opid_index: -1
I20260812 11:17:41.048609 26316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } }
I20260812 11:17:41.058215 27102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 0 FOLLOWER]: Advancing to term 1
WARNING: no policy specified for oryx/127.15.164.252@KRBTEST.COM; defaulting to no policy
I20260812 11:17:41.063597 27102 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 11:17:41.064752 27190 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.252@KRBTEST.COM" created.
I20260812 11:17:41.066323 27188 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:41.091007 27190 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.164.253:34165
I20260812 11:17:41.092207 27039 master.cc:537] Master@127.15.164.253:34165 shutting down...
I20260812 11:17:41.092502 27188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.092888 27188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.111088 27102 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.115440 27210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.115835 27157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31479e69a16d48c7a0da920ac3fa5262. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.116110 27157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:41.115986 27210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:41.116511 27203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.116752 27203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: LEARNER
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.252.keytab.
Entry for principal oryx/127.15.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.252.keytab.
I20260812 11:17:41.122145 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:39769
--webserver_interface=127.15.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.252.keytab
--principal=oryx/127.15.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:41.157584 27039 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 11:17:41.158221 27039 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 11:17:41.158420 27039 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: stopping tablet replica
I20260812 11:17:41.167451 27039 master.cc:552] Master@127.15.164.253:34165 shutdown complete.
I20260812 11:17:41.167636 27039 master_runner.cc:305] Clearing existing system tablet
I20260812 11:17:41.168121 27039 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:41.168229 27039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:41.172406 27039 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:17:41.174830 27213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:41.175233 27039 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:41.175518 27039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260812 11:17:41.175622 27039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "1a452c3946f862d381686a08397b31c5"
server_key_iv: "52cc345da6d16a31c2aacaee6aef8134"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.180687 27039 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:41.188388 27039 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:17:41.188609 27039 log.cc:1196] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 11:17:41.189214 27039 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Deleting consensus metadata
I20260812 11:17:41.189582 27039 master_runner.cc:315] Copying system tablet from 127.15.164.254:39501
I20260812 11:17:41.199476 27039 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: tablet copy: Beginning tablet copy session from remote peer at address 127.15.164.254:39501
I20260812 11:17:41.219848 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.200806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43574 (local address 127.15.164.254:39501)
0812 11:17:41.201011 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.201020 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.201430 (+ 410us) server_negotiation.cc:407] Connection header received
0812 11:17:41.201646 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.201653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.201743 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.201867 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.203008 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.204144 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.206073 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.206795 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.206930 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.212664 (+ 5734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.212672 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.212677 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.212724 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.216445 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.217395 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.217401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.217405 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.217577 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.218077 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.218083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.218089 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.218507 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.218676 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.219185 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.219442 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:17:41.219981 27223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.200587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43574)
0812 11:17:41.201283 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.201310 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.201486 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.201929 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.201935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.202543 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.202825 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.202838 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.204321 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.204328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.205902 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.205919 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.206980 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.206987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.207165 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.211038 (+ 3873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.211069 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.212327 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.216640 (+ 4313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.216649 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.216653 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.217248 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.217722 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.217730 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.217736 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.217934 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.218686 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.218692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.218896 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.219065 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.219499 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":390,"threads_started":1}
I20260812 11:17:41.221333 26344 tablet_copy_service.cc:140] P 31479e69a16d48c7a0da920ac3fa5262: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3278bcd67db74c6f9095c6f25bcf03d6 ({username='oryx', principal='oryx/127.15.164.253@KRBTEST.COM'} at 127.0.0.1:43574)
I20260812 11:17:41.221848 26344 tablet_copy_service.cc:161] P 31479e69a16d48c7a0da920ac3fa5262: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3278bcd67db74c6f9095c6f25bcf03d6 at {username='oryx', principal='oryx/127.15.164.253@KRBTEST.COM'} at 127.0.0.1:43574: session id = 3278bcd67db74c6f9095c6f25bcf03d6-00000000000000000000000000000000
I20260812 11:17:41.227334 26344 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:17:41.230885 27039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:17:41.238962 27039 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: tablet copy: Starting download of 0 data blocks...
I20260812 11:17:41.239430 27039 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: tablet copy: Starting download of 1 WAL segments...
I20260812 11:17:41.243979 27039 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:17:41.250216 26344 tablet_copy_service.cc:342] P 31479e69a16d48c7a0da920ac3fa5262: Request end of tablet copy session 3278bcd67db74c6f9095c6f25bcf03d6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.164.253@KRBTEST.COM'} at 127.0.0.1:43574
I20260812 11:17:41.250588 26344 tablet_copy_service.cc:433] P 31479e69a16d48c7a0da920ac3fa5262: ending tablet copy session 3278bcd67db74c6f9095c6f25bcf03d6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3278bcd67db74c6f9095c6f25bcf03d6
I20260812 11:17:41.262871 27039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:41.266265 27224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:41.272269 27225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:41.284447 27039 server_base.cc:1034] running on GCE node
W20260812 11:17:41.285326 27227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:41.285910 27039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:41.286700 27039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:41.287943 27039 hybrid_clock.cc:648] HybridClock initialized: now 1786533461287850 us; error 53 us; skew 500 ppm
I20260812 11:17:41.288194 27039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533461, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:41.290867 27039 init.cc:377] Logged in from keytab as oryx/127.15.164.253@KRBTEST.COM (short username oryx)
I20260812 11:17:41.292388 27039 webserver.cc:460] Webserver started at http://127.15.164.253:35611/ using document root <none> and password file <none>
I20260812 11:17:41.292841 27039 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:41.292938 27039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:41.296347 27039 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260812 11:17:41.308920 27029 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
I20260812 11:17:41.311287 27239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:41.321266 27039 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.012s sys 0.000s
I20260812 11:17:41.321630 27039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "1a452c3946f862d381686a08397b31c5"
server_key_iv: "52cc345da6d16a31c2aacaee6aef8134"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.321919 27039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:41.364579 27039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:41.370042 27039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:41.405673 27039 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.253:34165
I20260812 11:17:41.405786 27317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.253:34165 every 8 connection(s)
I20260812 11:17:41.406848 27039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
I20260812 11:17:41.414636 27318 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:17:41.419592 27318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Bootstrap starting.
I20260812 11:17:41.436810 27318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:17:41.437554 27318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: Bootstrap complete.
I20260812 11:17:41.438799 27318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } }
I20260812 11:17:41.439102 27318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3278bcd67db74c6f9095c6f25bcf03d6, State: Initialized, Role: LEARNER
I20260812 11:17:41.439397 27318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } }
I20260812 11:17:41.440385 27326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.440677 27318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:41.440865 27326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:41.449579 27350 catalog_manager.cc:1259] Loaded cluster ID: a5b6c07957d04f38b104b4bf378c1b55
I20260812 11:17:41.449712 27350 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: loading cluster ID for follower catalog manager: success
I20260812 11:17:41.453542 27350 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: acquiring CA information for follower catalog manager: success
I20260812 11:17:41.456626 27350 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:17:41.577324 27211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:41.577680 27211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:41.577837 27211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:41.585283 27211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:41.585455 27211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:41.585574 27211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:41.585683 27211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:41.585772 27211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:41.597034 27211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.252.keytab
--principal=oryx/127.15.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:39769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:41.598623 27211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:41.600081 27211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:41.613130 27359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:41.613155 27358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:41.613185 27363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:41.614064 27211 server_base.cc:1034] running on GCE node
I20260812 11:17:41.615088 27211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:41.616657 27211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:41.617920 27211 hybrid_clock.cc:648] HybridClock initialized: now 1786533461617882 us; error 40 us; skew 500 ppm
I20260812 11:17:41.618326 27211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533461, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:41.622165 27211 init.cc:377] Logged in from keytab as oryx/127.15.164.252@KRBTEST.COM (short username oryx)
I20260812 11:17:41.623956 27211 webserver.cc:460] Webserver started at http://127.15.164.252:36341/ using document root <none> and password file <none>
I20260812 11:17:41.624750 27211 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:41.624909 27211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:41.625255 27211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:41.628523 27211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/instance:
uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
format_stamp: "Formatted at 2026-08-12 11:17:41 on dist-test-slave-7kzw"
server_key: "110c6b6384e8f962ac275731c7127f55"
server_key_iv: "28a6bacba0c4d1027a9602075c8800aa"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.629390 27211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal/instance:
uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
format_stamp: "Formatted at 2026-08-12 11:17:41 on dist-test-slave-7kzw"
server_key: "110c6b6384e8f962ac275731c7127f55"
server_key_iv: "28a6bacba0c4d1027a9602075c8800aa"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.633589 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.633956 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.644117 27211 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.007s sys 0.009s
I20260812 11:17:41.649132 27377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.633716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43804)
0812 11:17:41.641974 (+ 8258us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.642002 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.642245 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.642819 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.642825 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.642855 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:41.643037 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.643046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.644619 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.644626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.646717 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.646739 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.648177 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.648183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.648399 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.648472 (+ 73us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.648595 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.648747 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8020,"thread_start_us":7874,"threads_started":1}
I20260812 11:17:41.649127 27385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.634236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.15.164.253:34165)
0812 11:17:41.641419 (+ 7183us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.641430 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.642410 (+ 980us) server_negotiation.cc:407] Connection header received
0812 11:17:41.642526 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.642534 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.642626 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.642774 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:41.643255 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.644435 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.646947 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.647848 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.648197 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.648398 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.648626 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.648779 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6972,"thread_start_us":6792,"threads_started":1}
I20260812 11:17:41.650106 27387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:41.650380 27326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31479e69a16d48c7a0da920ac3fa5262. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.650745 27326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:41.651510 27376 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: attempting to promote NON_VOTER 3278bcd67db74c6f9095c6f25bcf03d6 to VOTER
I20260812 11:17:41.651983 27211 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260812 11:17:41.652202 27211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
format_stamp: "Formatted at 2026-08-12 11:17:41 on dist-test-slave-7kzw"
server_key: "110c6b6384e8f962ac275731c7127f55"
server_key_iv: "28a6bacba0c4d1027a9602075c8800aa"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.652360 27376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } }
I20260812 11:17:41.652446 27211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:41.654528 27279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 LEARNER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:17:41.655208 27375 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 11:17:41.658954 27376 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } }
I20260812 11:17:41.659842 27279 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } }
I20260812 11:17:41.668268 27326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } }
I20260812 11:17:41.668701 27326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:41.670398 27375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } }
I20260812 11:17:41.670749 27375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.671083 27375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } }
I20260812 11:17:41.671375 27375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.692653 27211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:41.698669 27211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:41.699062 27211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:41.733219 27211 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.252:39769
I20260812 11:17:41.733265 27469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.252:39769 every 8 connection(s)
I20260812 11:17:41.734951 27211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
I20260812 11:17:41.738265 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 27211
I20260812 11:17:41.740252 27471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:41.751456 27471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533461, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.252@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:41.769018 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.740964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.15.164.252:39769)
0812 11:17:41.742046 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.742062 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.742309 (+ 247us) server_negotiation.cc:407] Connection header received
0812 11:17:41.744419 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.744443 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.744943 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.745312 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.747408 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.748952 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.750900 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.751822 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.752003 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.759096 (+ 7093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.759110 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.759123 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.759215 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.762851 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.764930 (+ 2079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.764939 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.764950 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.765170 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.765748 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.765754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.765757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.766442 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.766828 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.767418 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.767932 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":441,"threads_started":1}
I20260812 11:17:41.773092 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.755323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43580)
0812 11:17:41.756606 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.756674 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.756967 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.757623 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.757631 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.758775 (+ 1144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.759344 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.759357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.760801 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.760808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.762035 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.762048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.762969 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.762976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.763162 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.763827 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.763846 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.766536 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.770259 (+ 3723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.770272 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.770278 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.770891 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.771329 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.771332 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.771334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.771479 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.772197 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.772204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.772382 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.772533 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.772797 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":730,"threads_started":1}
I20260812 11:17:41.773283 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.755306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.15.164.254:39501)
0812 11:17:41.756039 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.756048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.756815 (+ 767us) server_negotiation.cc:407] Connection header received
0812 11:17:41.757237 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.757242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.757319 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.757473 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.759512 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.760601 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.762200 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.762760 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.762911 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.766760 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.766766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.766769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.766805 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.770101 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.771028 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.771033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.771037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.771208 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.771600 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.771604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.771607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.772032 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.772187 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.772698 (+ 511us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.772933 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":397,"threads_started":1}
I20260812 11:17:41.774672 27471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533461, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.252@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:41.789343 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.775559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43820)
0812 11:17:41.775822 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.775844 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.775978 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.776329 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.776334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.776731 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.776884 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.776893 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.777917 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.777923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.778966 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.778978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.779715 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.779721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.779980 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.780631 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.780649 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.782869 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.786447 (+ 3578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.786451 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.786454 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.786979 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.787637 (+ 658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.787641 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.787643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.787802 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.788472 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.788476 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.788634 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.788751 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.789004 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:17:41.789775 27385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.775565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.15.164.253:34165)
0812 11:17:41.775816 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.775823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.775917 (+ 94us) server_negotiation.cc:407] Connection header received
0812 11:17:41.776122 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.776126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.776191 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.776305 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.777035 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.777764 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.779113 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.779541 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.779682 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.783110 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.783116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.783120 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.783160 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.786267 (+ 3107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.787190 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.787195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.787197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.787436 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.787958 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.787963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.787966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.788325 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.788478 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.788958 (+ 480us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.789314 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:17:41.790998 27471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533461, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.252@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
I20260812 11:17:41.805871 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.791913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.0.0.1:42074)
0812 11:17:41.792136 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.792156 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.792300 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.792596 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.792600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.793047 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.793192 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.793201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.794265 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.794271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.795271 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.795284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.795998 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.796004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.796194 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.796880 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.796899 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.799270 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.802885 (+ 3615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.802891 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.802896 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.803304 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.803739 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.803745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.803749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.803917 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.804497 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.804502 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.804762 (+ 260us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.804920 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.805241 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 11:17:41.805869 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.791859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.15.164.252:39769)
0812 11:17:41.792116 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.792123 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.792233 (+ 110us) server_negotiation.cc:407] Connection header received
0812 11:17:41.792412 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.792418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.792476 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.792576 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.793326 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.794133 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.795411 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.795836 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.795978 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.799470 (+ 3492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.799474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.799485 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.799514 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.802726 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.803437 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.803442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.803446 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.803600 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.804048 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.804056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.804064 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.804368 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.804542 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.805007 (+ 465us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.805425 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":163,"server-negotiator.queue_time_us":123}
I20260812 11:17:41.811998 27471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Bootstrap starting.
I20260812 11:17:41.815528 27471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:41.816800 27471 log.cc:824] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:41.819744 27471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: No bootstrap required, opened a new log
I20260812 11:17:41.827793 27471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } }
I20260812 11:17:41.828177 27471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:41.828325 27471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 734d3e36c17b48a5b3f4cc14d09fffd0, State: Initialized, Role: FOLLOWER
I20260812 11:17:41.828933 27471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } }
I20260812 11:17:41.829844 27481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } } }
I20260812 11:17:41.830147 27481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:41.830981 27471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:17:41.841547 27500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:17:41.841727 27500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:17:41.847354 27211 master_runner.cc:428] Detected that this master 734d3e36c17b48a5b3f4cc14d09fffd0 is joining an existing cluster
I20260812 11:17:41.847579 27211 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.164.252:39769
I20260812 11:17:41.872993 27385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.852885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43836 (local address 127.15.164.253:34165)
0812 11:17:41.853128 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.853136 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.856368 (+ 3232us) server_negotiation.cc:407] Connection header received
0812 11:17:41.856667 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.856673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.856765 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.856845 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.858744 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.859889 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.862069 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.862772 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.862876 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.865904 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.865911 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.865916 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.865961 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.869545 (+ 3584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.870421 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.870427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.870432 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.870620 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.871144 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.871149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.871153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.871521 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.871660 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.872348 (+ 688us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.872608 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:17:41.874179 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.853558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:43836)
0812 11:17:41.856257 (+ 2699us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.856275 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.856494 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.857087 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.857092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.857950 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.858410 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.858425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.860148 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.860154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.861866 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.861886 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.863197 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.863204 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.863481 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.864286 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.864311 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.865615 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.869713 (+ 4098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.869719 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.869723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.870269 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.870783 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.870788 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.870792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.871007 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.871773 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.871778 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.871994 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.873296 (+ 1302us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.873666 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2540,"mutex_wait_us":1,"thread_start_us":2059,"threads_started":1}
I20260812 11:17:41.876247 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 26416
I20260812 11:17:41.880045 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.852983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43596 (local address 127.15.164.254:39501)
0812 11:17:41.853243 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.853250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.856235 (+ 2985us) server_negotiation.cc:407] Connection header received
0812 11:17:41.856663 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.856674 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.856799 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.856901 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.859612 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.861203 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.864357 (+ 3154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.865186 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.865312 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.869128 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.869136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.869141 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.869194 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.873979 (+ 4785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.875530 (+ 1551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.875539 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.875542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.875743 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.876311 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.876320 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.876323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.876906 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.877080 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.879331 (+ 2251us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.879616 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:17:41.881464 27510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.852406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43596)
0812 11:17:41.856068 (+ 3662us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.856099 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.856425 (+ 326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.857182 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.857190 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.858736 (+ 1546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.859259 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.859280 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.861500 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.861509 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.863727 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.863744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.865726 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.865735 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.865916 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.867167 (+ 1251us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.867204 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.868880 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.874204 (+ 5324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.874212 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.874219 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.875365 (+ 1146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.875916 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.875920 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.875923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.876143 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.877183 (+ 1040us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.877190 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.877530 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.880339 (+ 2809us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.880808 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3420,"mutex_wait_us":32,"thread_start_us":2150,"threads_started":1}
I20260812 11:17:41.884248 27512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.854881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.0.0.1:42078)
0812 11:17:41.862559 (+ 7678us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.862585 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.862996 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.863504 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.863511 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.864352 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.864853 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.864868 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.866606 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.866615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.868875 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.868887 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.870352 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.870362 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.870633 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.871430 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.871462 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.873247 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.880925 (+ 7678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.880931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.880934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.881572 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.882151 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.882156 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.882159 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.882314 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.883077 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.883084 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.883286 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.883436 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.883756 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7500,"thread_start_us":7792,"threads_started":1}
I20260812 11:17:41.885280 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.852395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.15.164.252:39769)
0812 11:17:41.852895 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.852901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.862669 (+ 9768us) server_negotiation.cc:407] Connection header received
0812 11:17:41.863152 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.863157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.863228 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.863303 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.865021 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.866270 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.869033 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.869816 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.869955 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.873437 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.873444 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.873450 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.873493 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.880768 (+ 7275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.881853 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.881858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.881861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.882019 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.882446 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.882451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.882455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.882852 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.883026 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.884652 (+ 1626us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.884871 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.193@KRBTEST.COM
Aug 12 11:17:41 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533458, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.254@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
I20260812 11:17:41.903648 27513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.877998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.15.164.193:42397)
0812 11:17:41.879214 (+ 1216us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.879224 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.879255 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:17:41.879327 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.879336 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.879664 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.881793 (+ 2129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.882111 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.883828 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.886157 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.888210 (+ 2053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.888425 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.895535 (+ 7110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.895553 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.895579 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.895642 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.899775 (+ 4133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.900731 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.900742 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.900746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.900925 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.901518 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.901523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.901525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.901927 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.902307 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.902778 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.903103 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972,"thread_start_us":807,"threads_started":1}
I20260812 11:17:41.905519 26597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:41.907702 27377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.888548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.0.0.1:42082)
0812 11:17:41.888734 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:41.888756 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:41.888868 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:41.889508 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:41.889514 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:41.890052 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:41.890209 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.890219 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.891744 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.891753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.893559 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:41.893581 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.894782 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.894793 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:41.894995 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.895729 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:41.895756 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:41.898823 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:41.903566 (+ 4743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.903573 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.903579 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.904335 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.905060 (+ 725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:41.905067 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:41.905071 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:41.905276 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:41.906184 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:41.906193 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:41.906452 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 11:17:41.906713 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 11:17:41.907128 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 11:17:41.909031 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:41.888923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.15.164.252:39769)
0812 11:17:41.889081 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:41.889087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:41.889109 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:17:41.889214 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:41.889219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:41.889329 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:41.889433 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:41.890392 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.891577 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.893732 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:41.894578 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:41.894728 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:41.899092 (+ 4364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:41.899101 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:41.899125 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:41.899174 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:41.903392 (+ 4218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.904576 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.904582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.904585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.904772 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:41.905433 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:41.905440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:41.905444 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:41.905911 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:41.906089 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:41.908149 (+ 2060us) server_negotiation.cc:299] Negotiation successful
0812 11:17:41.908506 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:17:41.910735 26316 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.164.252:39769: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
member_type: NON_VOTER
last_known_addr {
host: "127.15.164.252"
port: 39769
}
attrs {
promote: true
}
}
dest_uuid: "31479e69a16d48c7a0da920ac3fa5262"
cas_config_opid_index: 6
I20260812 11:17:41.911480 26316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } }
I20260812 11:17:41.913919 27279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 11:17:41.914093 27431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:41.914819 27376 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 11:17:41.918004 27376 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.918663 27431 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 11:17:41.919279 27279 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.922227 27374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:41.928526 27326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.928927 27326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:41.930150 27376 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.164.252:39769
I20260812 11:17:41.930965 27211 master.cc:537] Master@127.15.164.252:39769 shutting down...
I20260812 11:17:41.932444 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.932859 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.933351 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.933693 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.938180 27431 raft_consensus.cc:858] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } }
W20260812 11:17:41.938596 27431 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } }
W20260812 11:17:41.958946 27397 tablet.cc:2369] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:41.967993 27431 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.972350 27519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.972769 27519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 11:17:41.973341 27481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31479e69a16d48c7a0da920ac3fa5262. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.973557 27481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 11:17:41.974110 27376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:41.974503 27376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:41.974761 27525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: NON_VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: true } } }
I20260812 11:17:41.975087 27525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: NON_PARTICIPANT
W20260812 11:17:41.976089 26297 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260812 11:17:41.976671 27211 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260812 11:17:41.977286 27211 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 11:17:41.977512 27211 tablet_replica.cc:330] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: stopping tablet replica
W20260812 11:17:41.981150 26297 consensus_peers.cc:487] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 -> Peer 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252:39769): Couldn't send request to peer 734d3e36c17b48a5b3f4cc14d09fffd0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:17:41.985275 27211 master.cc:552] Master@127.15.164.252:39769 shutdown complete.
I20260812 11:17:41.985383 27211 master_runner.cc:305] Clearing existing system tablet
I20260812 11:17:41.985723 27211 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:41.985857 27211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:41.988409 27211 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:17:41.990087 27530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:41.990414 27211 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:41.990720 27211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:17:41.990828 27211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
format_stamp: "Formatted at 2026-08-12 11:17:41 on dist-test-slave-7kzw"
server_key: "110c6b6384e8f962ac275731c7127f55"
server_key_iv: "28a6bacba0c4d1027a9602075c8800aa"
server_key_version: "encryptionkey@0"
I20260812 11:17:41.993943 27211 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:41.998705 27211 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:17:41.998907 27211 log.cc:1196] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 11:17:41.999399 27211 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Deleting consensus metadata
I20260812 11:17:41.999662 27211 master_runner.cc:315] Copying system tablet from 127.15.164.254:39501
I20260812 11:17:42.002370 27211 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: tablet copy: Beginning tablet copy session from remote peer at address 127.15.164.254:39501
I20260812 11:17:42.019200 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.003239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.15.164.254:39501)
0812 11:17:42.003521 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.003532 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.007385 (+ 3853us) server_negotiation.cc:407] Connection header received
0812 11:17:42.007757 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.007762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.007835 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.007951 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:42.008898 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.009624 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.010977 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.011437 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.011577 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.013507 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:42.013516 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:42.013525 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:42.013558 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:42.016366 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.017038 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.017046 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.017050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.017191 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.017614 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.017621 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.017624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.017919 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:42.018081 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.018541 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.018802 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260812 11:17:42.019404 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.003194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:43602)
0812 11:17:42.007189 (+ 3995us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:42.007247 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:42.007566 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:42.007984 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:42.007988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:42.008535 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:42.008740 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.008750 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.009786 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.009792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.010815 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.010828 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.011606 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.011612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.011790 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.012493 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:42.012515 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:42.013310 (+ 795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:42.016517 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.016523 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.016527 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.016914 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.017326 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.017332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.017335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.017492 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.018049 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:42.018054 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:42.018240 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 11:17:42.018392 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:17:42.018794 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3793,"thread_start_us":3583,"threads_started":1}
I20260812 11:17:42.020366 26344 tablet_copy_service.cc:140] P 31479e69a16d48c7a0da920ac3fa5262: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 734d3e36c17b48a5b3f4cc14d09fffd0 ({username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:43602)
I20260812 11:17:42.020550 26344 tablet_copy_service.cc:161] P 31479e69a16d48c7a0da920ac3fa5262: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 734d3e36c17b48a5b3f4cc14d09fffd0 at {username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:43602: session id = 734d3e36c17b48a5b3f4cc14d09fffd0-00000000000000000000000000000000
I20260812 11:17:42.023154 26344 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:17:42.025046 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:17:42.031940 27211 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: tablet copy: Starting download of 0 data blocks...
I20260812 11:17:42.032348 27211 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: tablet copy: Starting download of 1 WAL segments...
I20260812 11:17:42.035547 27211 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:17:42.039556 26344 tablet_copy_service.cc:342] P 31479e69a16d48c7a0da920ac3fa5262: Request end of tablet copy session 734d3e36c17b48a5b3f4cc14d09fffd0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:43602
I20260812 11:17:42.039731 26344 tablet_copy_service.cc:433] P 31479e69a16d48c7a0da920ac3fa5262: ending tablet copy session 734d3e36c17b48a5b3f4cc14d09fffd0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 734d3e36c17b48a5b3f4cc14d09fffd0
I20260812 11:17:42.055043 27211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:17:42.061317 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 26416
W20260812 11:17:42.066998 27537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:42.067059 27538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:42.075889 27540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:42.084201 27211 server_base.cc:1034] running on GCE node
I20260812 11:17:42.084741 27211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:42.085564 27211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:42.086829 27211 hybrid_clock.cc:648] HybridClock initialized: now 1786533462086782 us; error 47 us; skew 500 ppm
I20260812 11:17:42.087100 27211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533462, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:42.089190 27211 init.cc:377] Logged in from keytab as oryx/127.15.164.252@KRBTEST.COM (short username oryx)
I20260812 11:17:42.095646 27211 webserver.cc:460] Webserver started at http://127.15.164.252:36801/ using document root <none> and password file <none>
I20260812 11:17:42.096082 27211 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:42.096205 27211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:42.096369 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:42397
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:39501
--webserver_port=38847
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:42.103711 27211 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:17:42.106339 27551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:42.106897 27211 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:17:42.107041 27211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "734d3e36c17b48a5b3f4cc14d09fffd0"
format_stamp: "Formatted at 2026-08-12 11:17:41 on dist-test-slave-7kzw"
server_key: "110c6b6384e8f962ac275731c7127f55"
server_key_iv: "28a6bacba0c4d1027a9602075c8800aa"
server_key_version: "encryptionkey@0"
I20260812 11:17:42.107250 27211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:42.130192 27211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:42.134886 27211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:42.157104 27211 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.252:39769
I20260812 11:17:42.157173 27630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.252:39769 every 8 connection(s)
I20260812 11:17:42.158249 27211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
I20260812 11:17:42.165783 27632 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:17:42.171334 27632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Bootstrap starting.
I20260812 11:17:42.187835 27632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:17:42.188542 27632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Bootstrap complete.
I20260812 11:17:42.189872 27632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } }
I20260812 11:17:42.190194 27632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 734d3e36c17b48a5b3f4cc14d09fffd0, State: Initialized, Role: LEARNER
I20260812 11:17:42.190670 27632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } }
I20260812 11:17:42.191668 27635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:42.192005 27632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:42.192194 27635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:42.201202 27654 catalog_manager.cc:1259] Loaded cluster ID: a5b6c07957d04f38b104b4bf378c1b55
I20260812 11:17:42.201321 27654 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: loading cluster ID for follower catalog manager: success
I20260812 11:17:42.204782 27654 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: acquiring CA information for follower catalog manager: success
I20260812 11:17:42.207561 27654 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:17:42.446240 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:42.446624 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:42.454758 27656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.446683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.0.0.1:42096)
0812 11:17:42.447299 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:42.447325 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:42.447529 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:42.448449 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:42.448455 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:42.448492 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:42.448825 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.448843 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.450224 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.450231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.452328 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.452350 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.453771 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.453780 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.453998 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.454042 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:17:42.454152 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 11:17:42.454315 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":320,"threads_started":1}
I20260812 11:17:42.454854 27657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.447089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42096 (local address 127.15.164.252:39769)
0812 11:17:42.448096 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.448101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.448118 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:17:42.448183 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.448187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.448259 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.448359 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:42.449036 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.450058 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.452511 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.453536 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.453725 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.453874 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.454212 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.454326 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":888,"thread_start_us":714,"threads_started":1}
I20260812 11:17:42.455849 27596 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260812 11:17:42.456350 27635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31479e69a16d48c7a0da920ac3fa5262. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: NON_VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: true } } }
I20260812 11:17:42.456722 27635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:17:42.457113 27374 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: attempting to promote NON_VOTER 734d3e36c17b48a5b3f4cc14d09fffd0 to VOTER
I20260812 11:17:42.458042 27374 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } }
I20260812 11:17:42.460539 27279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 11:17:42.460592 27596 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 LEARNER]: Refusing update from remote peer 31479e69a16d48c7a0da920ac3fa5262: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 11:17:42.461236 27375 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 11:17:42.461529 27374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 11:17:42.464334 27375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.468591 27375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.468961 27375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:42.469524 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.469861 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:42.470106 27279 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.471866 27596 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.474715 27660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.475159 27660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:42.478672 27635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.478945 27635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:42.479853 27659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31479e69a16d48c7a0da920ac3fa5262" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:42.480108 27659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262 [sys.catalog]: This master's current role is: LEADER
W20260812 11:17:42.511772 27550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:42.512137 27550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:42.512310 27550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:42.520061 27550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:42.520227 27550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:42.520416 27550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:42.531191 27550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:42397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=38847
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:42.532730 27550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:42.534416 27550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:42.554056 27668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:42.554154 27675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:42.554188 27670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:42.555315 27550 server_base.cc:1034] running on GCE node
I20260812 11:17:42.556006 27550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:42.557075 27550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:42.558339 27550 hybrid_clock.cc:648] HybridClock initialized: now 1786533462558296 us; error 35 us; skew 500 ppm
I20260812 11:17:42.558750 27550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533462, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:42.562649 27550 init.cc:377] Logged in from keytab as oryx/127.15.164.193@KRBTEST.COM (short username oryx)
I20260812 11:17:42.564172 27550 webserver.cc:460] Webserver started at http://127.15.164.193:38847/ using document root <none> and password file <none>
I20260812 11:17:42.564852 27550 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:42.564975 27550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:42.571416 27550 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:17:42.574445 27683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:42.576148 27550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:17:42.576347 27550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "8a7428ac391d4ecf923862889b8c0c4f"
format_stamp: "Formatted at 2026-08-12 11:17:38 on dist-test-slave-7kzw"
server_key: "ee1f7e244db2535649870e4ea1e7589d"
server_key_iv: "e446f56609514c7e8dc595c4512f8dca"
server_key_version: "encryptionkey@0"
I20260812 11:17:42.577356 27550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:42.595108 27550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:42.599656 27550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:42.599967 27550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:42.601068 27550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:42.602617 27550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:42.602708 27550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:42.602845 27550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:42.602931 27550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:42.647694 27550 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:42397
I20260812 11:17:42.647836 27863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:42397 every 8 connection(s)
I20260812 11:17:42.649456 27550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:42.657508 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 27550
I20260812 11:17:42.657951 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 26615
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.194@KRBTEST.COM
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533462, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:42.689019 27877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.659194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39146 (local address 127.15.164.194:41295)
0812 11:17:42.665911 (+ 6717us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.665922 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.665957 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:17:42.666031 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.666041 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.666361 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.666566 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:42.668845 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.670983 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.673182 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.673757 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.673912 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.681152 (+ 7240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:42.681168 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:42.681186 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:42.681236 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:42.685270 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.686257 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.686268 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.686272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.686438 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.686969 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.686974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.686976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.687449 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:42.687814 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.688421 (+ 607us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.688630 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6441,"thread_start_us":7297,"threads_started":1}
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533462, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
I20260812 11:17:42.691064 26817 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 12 11:17:42 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533462, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:42.699637 27657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.653219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:39983 (local address 127.15.164.252:39769)
0812 11:17:42.653695 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.653703 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.675112 (+ 21409us) server_negotiation.cc:407] Connection header received
0812 11:17:42.675432 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.675440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.675533 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.675609 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:42.678981 (+ 3372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680160 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.684227 (+ 4067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.684932 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.685034 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.690371 (+ 5337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:42.690376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:42.690379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:42.690413 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:42.694950 (+ 4537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.696176 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.696183 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.696186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.696382 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.696946 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.696957 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.696962 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.697385 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:42.697583 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.698812 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.699165 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321}
I20260812 11:17:42.703200 27875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.655126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.15.164.193:39983)
0812 11:17:42.674987 (+ 19861us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:42.675007 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:42.675233 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:42.676166 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:42.676180 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:42.677317 (+ 1137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:42.678738 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.678765 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680409 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.680414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.684057 (+ 3643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.684070 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.685341 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.685347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.685573 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.686314 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:42.686349 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:42.690150 (+ 3801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:42.695142 (+ 4992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.695152 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.695169 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.696020 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.696532 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.696539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.696543 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.696797 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.697536 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:42.697544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:42.698029 (+ 485us) client_negotiation.cc:769] Sending connection context
0812 11:17:42.699913 (+ 1884us) client_negotiation.cc:240] Negotiation successful
0812 11:17:42.700582 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19724,"mutex_wait_us":367,"spinlock_wait_cycles":37248,"thread_start_us":19561,"threads_started":1}
I20260812 11:17:42.703341 27872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.653891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.15.164.193:49073)
0812 11:17:42.668370 (+ 14479us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:42.668448 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:42.671710 (+ 3262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:42.676287 (+ 4577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:42.676295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:42.677343 (+ 1048us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:42.678734 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.678762 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680407 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.680412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.683576 (+ 3164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.683592 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.685018 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.685025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.685360 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.686452 (+ 1092us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:42.686500 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:42.689792 (+ 3292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:42.698702 (+ 8910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.698710 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.698715 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.699421 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.700219 (+ 798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.700226 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.700232 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.700461 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.701810 (+ 1349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:42.701817 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:42.702064 (+ 247us) client_negotiation.cc:769] Sending connection context
0812 11:17:42.702286 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 11:17:42.702785 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14081,"mutex_wait_us":486,"spinlock_wait_cycles":11776,"thread_start_us":18216,"threads_started":1}
I20260812 11:17:42.705569 27864 heartbeater.cc:347] Connected to a master server at 127.15.164.252:39769
I20260812 11:17:42.705958 27873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.653891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:41823)
0812 11:17:42.672291 (+ 18400us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:42.672336 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:42.672462 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:42.676825 (+ 4363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:42.676829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:42.677528 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:42.678738 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.678762 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680589 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.680593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.683580 (+ 2987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:42.683600 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.684992 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.685003 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:42.685397 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.686166 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:42.686205 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:42.692261 (+ 6056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:42.702100 (+ 9839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.702105 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.702109 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.702776 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.703314 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:42.703319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:42.703326 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:42.703560 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:42.704605 (+ 1045us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:42.704611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:42.704829 (+ 218us) client_negotiation.cc:769] Sending connection context
0812 11:17:42.705109 (+ 280us) client_negotiation.cc:240] Negotiation successful
0812 11:17:42.705413 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18199,"mutex_wait_us":526,"spinlock_wait_cycles":47872,"thread_start_us":18419,"threads_started":1}
I20260812 11:17:42.706065 27864 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:42.706532 27870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.653865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41823 (local address 127.15.164.254:39501)
0812 11:17:42.676332 (+ 22467us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.676338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.676358 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:42.676420 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.676425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.676504 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.676621 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:42.678953 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680426 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.683797 (+ 3371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.684498 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.684635 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.692565 (+ 7930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:42.692576 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:42.692584 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:42.692693 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:42.701894 (+ 9201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.702949 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.702955 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.702959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.703148 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.703913 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.703925 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.703928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.704343 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:42.704528 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.705772 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.706053 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22314,"thread_start_us":22211,"threads_started":1}
I20260812 11:17:42.707333 27864 heartbeater.cc:511] Master 127.15.164.252:39769 requested a full tablet report, sending...
I20260812 11:17:42.707412 27874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:42.654295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:49073 (local address 127.15.164.253:34165)
0812 11:17:42.675342 (+ 21047us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:42.675352 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:42.675380 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:17:42.675463 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:42.675471 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:42.675578 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:42.675734 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:42.678965 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.680201 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.683784 (+ 3583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:42.684599 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:42.684728 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:42.690092 (+ 5364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:42.690099 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:42.690104 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:42.690151 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:42.697525 (+ 7374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.699650 (+ 2125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.699657 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.699661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.700030 (+ 369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:42.700637 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:42.700641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:42.700645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:42.701060 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:42.702655 (+ 1595us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:42.702836 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 11:17:42.703110 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20822,"thread_start_us":20661,"threads_started":1}
I20260812 11:17:42.707442 27867 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:42.707604 27867 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:42.708220 27867 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:42.708822 27868 heartbeater.cc:347] Connected to a master server at 127.15.164.253:34165
I20260812 11:17:42.708968 27868 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:42.709530 27868 heartbeater.cc:511] Master 127.15.164.253:34165 requested a full tablet report, sending...
I20260812 11:17:42.710039 26316 ts_manager.cc:194] Re-registered known tserver with Master: 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:42.711018 27579 ts_manager.cc:194] Registered new tserver with Master: 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:42.711208 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:41823
I20260812 11:17:42.711381 27264 ts_manager.cc:194] Registered new tserver with Master: 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:42.786818 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 26615
W20260812 11:17:42.814359 26295 connection.cc:535] server connection from 127.15.164.194:38933 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:17:42.815280 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:41295
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:39501
--webserver_port=36135
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:43.205744 27879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:43.206130 27879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:43.206311 27879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:43.215921 27879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:43.216091 27879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:43.216219 27879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:43.227185 27879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:41295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=36135
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:43.228731 27879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:43.230135 27879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:43.252110 27886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:43.251986 27890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:43.252063 27887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:43.253705 27879 server_base.cc:1034] running on GCE node
I20260812 11:17:43.254643 27879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:43.255932 27879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:43.257427 27879 hybrid_clock.cc:648] HybridClock initialized: now 1786533463257253 us; error 50 us; skew 500 ppm
I20260812 11:17:43.258047 27879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:43 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533463, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:43.262086 27879 init.cc:377] Logged in from keytab as oryx/127.15.164.194@KRBTEST.COM (short username oryx)
I20260812 11:17:43.264245 27879 webserver.cc:460] Webserver started at http://127.15.164.194:36135/ using document root <none> and password file <none>
I20260812 11:17:43.265014 27879 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:43.265151 27879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:43.272430 27879 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 11:17:43.276340 27908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:43.278002 27879 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:17:43.278187 27879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "4301cfc3431a4d6ab30c5379c4236ba1"
format_stamp: "Formatted at 2026-08-12 11:17:39 on dist-test-slave-7kzw"
server_key: "334e2f14f41dbdc81c56149de39c7b90"
server_key_iv: "e4506b35284114e604d1ccbcdcddd7b7"
server_key_version: "encryptionkey@0"
I20260812 11:17:43.279328 27879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:43.309799 27879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:43.316059 27879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:43.316424 27879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:43.317595 27879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:43.319303 27879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:43.319406 27879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:43.319564 27879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:43.319650 27879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:43.360455 27879 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:41295
I20260812 11:17:43.360602 28089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:41295 every 8 connection(s)
I20260812 11:17:43.362273 27879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:43.365530 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 27879
I20260812 11:17:43.366194 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 26834
Aug 12 11:17:43 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533463, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:43.425295 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.365937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:54053 (local address 127.15.164.254:39501)
0812 11:17:43.366665 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:43.366672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:43.378740 (+ 12068us) server_negotiation.cc:407] Connection header received
0812 11:17:43.387183 (+ 8443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:43.387195 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:43.387372 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:43.387486 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:43.391194 (+ 3708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.392626 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.396642 (+ 4016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.397961 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.398122 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.408652 (+ 10530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:43.408666 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:43.408675 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:43.408756 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:43.414122 (+ 5366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.415583 (+ 1461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.415591 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.415594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.415793 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.422027 (+ 6234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.422034 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.422039 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.422552 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:43.422708 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:43.424570 (+ 1862us) server_negotiation.cc:299] Negotiation successful
0812 11:17:43.424876 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":393,"threads_started":1}
I20260812 11:17:43.429374 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.366903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:54053)
0812 11:17:43.378445 (+ 11542us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:43.378550 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:43.386612 (+ 8062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:43.388400 (+ 1788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:43.388418 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:43.389562 (+ 1144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:43.390807 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.390849 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.392987 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.392997 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.396329 (+ 3332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.396363 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.398703 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.398715 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.399194 (+ 479us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.400299 (+ 1105us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:43.400355 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:43.406997 (+ 6642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:43.414450 (+ 7453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.414488 (+ 38us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.414514 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.415398 (+ 884us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.415986 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.415991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.415995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.421846 (+ 5851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.422820 (+ 974us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:43.422832 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:43.423977 (+ 1145us) client_negotiation.cc:769] Sending connection context
0812 11:17:43.424417 (+ 440us) client_negotiation.cc:240] Negotiation successful
0812 11:17:43.427633 (+ 3216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10958,"thread_start_us":51953,"threads_started":1}
Aug 12 11:17:43 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.195@KRBTEST.COM
Aug 12 11:17:43 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533463, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
I20260812 11:17:43.432420 28094 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:43.432750 28094 heartbeater.cc:464] Registering TS with master...
Aug 12 11:17:43 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533463, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:43.433832 28094 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:43.435549 26316 ts_manager.cc:194] Re-registered known tserver with Master: 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295)
I20260812 11:17:43.436709 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:54053
I20260812 11:17:43.441134 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.367514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.15.164.195:43667)
0812 11:17:43.415722 (+ 48208us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:43.415733 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:43.415769 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:17:43.415851 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:43.415865 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:43.416240 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:43.416447 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:43.420077 (+ 3630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.421701 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.423882 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.424704 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.425857 (+ 1153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.431188 (+ 5331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:43.431207 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:43.431228 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:43.431281 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:43.436187 (+ 4906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.437469 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.437480 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.437486 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.437694 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.438426 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.438433 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.438439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.438922 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:43.439253 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:43.440453 (+ 1200us) server_negotiation.cc:299] Negotiation successful
0812 11:17:43.440683 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47948,"thread_start_us":50983,"threads_started":1}
I20260812 11:17:43.442443 27020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:43.443327 28111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.367434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.15.164.194:60523)
0812 11:17:43.409164 (+ 41730us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:43.409189 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:43.409355 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:43.411829 (+ 2474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:43.411838 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:43.412719 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:43.413116 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.413136 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.416873 (+ 3737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.416880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.420898 (+ 4018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.420915 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.426756 (+ 5841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.426767 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.427024 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.429960 (+ 2936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:43.429988 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:43.433723 (+ 3735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:43.438408 (+ 4685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.438414 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.438418 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.439211 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.439786 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.439796 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.439804 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.440011 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.440982 (+ 971us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:43.440988 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:43.441225 (+ 237us) client_negotiation.cc:769] Sending connection context
0812 11:17:43.442290 (+ 1065us) client_negotiation.cc:240] Negotiation successful
0812 11:17:43.442677 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41544,"thread_start_us":10263,"threads_started":1}
I20260812 11:17:43.443361 28110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.367920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:60523 (local address 127.15.164.252:39769)
0812 11:17:43.410993 (+ 43073us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:43.411000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:43.411026 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:17:43.411164 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:43.411175 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:43.411282 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:43.411498 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:43.413355 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.415000 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.422350 (+ 7350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.423114 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.423293 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.434117 (+ 10824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:43.434128 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:43.434134 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:43.434202 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:43.438197 (+ 3995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.439405 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.439412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.439417 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.439612 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.440167 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.440173 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.440178 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.440823 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:43.441009 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:43.442496 (+ 1487us) server_negotiation.cc:299] Negotiation successful
0812 11:17:43.442843 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42902,"thread_start_us":50633,"threads_started":1}
I20260812 11:17:43.444868 28092 heartbeater.cc:347] Connected to a master server at 127.15.164.252:39769
I20260812 11:17:43.445055 28092 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:43.445607 28092 heartbeater.cc:511] Master 127.15.164.252:39769 requested a full tablet report, sending...
I20260812 11:17:43.447432 27579 ts_manager.cc:194] Registered new tserver with Master: 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295)
I20260812 11:17:43.448518 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.380581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.15.164.194:45235)
0812 11:17:43.419643 (+ 39062us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:43.419719 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:43.421183 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:43.421791 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:43.421796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:43.424378 (+ 2582us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:43.424819 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.424835 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.426697 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.426703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.428556 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:43.428573 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.429531 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.429537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:43.429739 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.430386 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:43.430411 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:43.437686 (+ 7275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:43.443012 (+ 5326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.443018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.443023 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.443838 (+ 815us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.446002 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:43.446007 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:43.446011 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:43.446223 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:43.447138 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:43.447147 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:43.447373 (+ 226us) client_negotiation.cc:769] Sending connection context
0812 11:17:43.447536 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 11:17:43.447996 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38866,"mutex_wait_us":4,"thread_start_us":29541,"threads_started":1}
I20260812 11:17:43.449731 28112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:43.381320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:45235 (local address 127.15.164.253:34165)
0812 11:17:43.410045 (+ 28725us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:43.410054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:43.419856 (+ 9802us) server_negotiation.cc:407] Connection header received
0812 11:17:43.421358 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:43.421365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:43.421449 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:43.421526 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:43.425039 (+ 3513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.426429 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.428771 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:43.429318 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:43.429481 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:43.438704 (+ 9223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:43.438714 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:43.438720 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:43.438784 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:43.442826 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.444021 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.444031 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.444038 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.445745 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:43.446390 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:43.446398 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:43.446405 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:43.446959 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:43.448944 (+ 1985us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:43.449073 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:17:43.449277 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28535,"thread_start_us":28722,"threads_started":1}
I20260812 11:17:43.450906 28095 heartbeater.cc:347] Connected to a master server at 127.15.164.253:34165
I20260812 11:17:43.451073 28095 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:43.451454 28095 heartbeater.cc:511] Master 127.15.164.253:34165 requested a full tablet report, sending...
I20260812 11:17:43.452838 27264 ts_manager.cc:194] Registered new tserver with Master: 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295)
I20260812 11:17:43.535677 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 26834
I20260812 11:17:43.577265 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:43667
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:39501
--webserver_port=35327
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:43.713879 27867 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
W20260812 11:17:43.976497 28115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:43.976917 28115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:43.977118 28115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:43.986438 28115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:43.986693 28115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:43.986918 28115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:43.999454 28115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:43667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=35327
--tserver_master_addrs=127.15.164.254:39501,127.15.164.253:34165,127.15.164.252:39769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:44.001104 28115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:44.002707 28115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:44.018671 28122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:44.018747 28123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:44.018764 28126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:44.020275 28115 server_base.cc:1034] running on GCE node
I20260812 11:17:44.020993 28115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:44.022148 28115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:44.023423 28115 hybrid_clock.cc:648] HybridClock initialized: now 1786533464023341 us; error 77 us; skew 500 ppm
I20260812 11:17:44.023823 28115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:44 dist-test-slave-7kzw krb5kdc[26247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533464, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:44.027815 28115 init.cc:377] Logged in from keytab as oryx/127.15.164.195@KRBTEST.COM (short username oryx)
I20260812 11:17:44.029590 28115 webserver.cc:460] Webserver started at http://127.15.164.195:35327/ using document root <none> and password file <none>
I20260812 11:17:44.030437 28115 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:44.030702 28115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:44.037144 28115 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:17:44.040936 28137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:44.042941 28115 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:17:44.043215 28115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "d17e6c3b934d42fc81189e8b10f19221"
format_stamp: "Formatted at 2026-08-12 11:17:40 on dist-test-slave-7kzw"
server_key: "7f02db3cc2182c2646191c19526eef19"
server_key_iv: "236499cfd98f67560e13382be91713d3"
server_key_version: "encryptionkey@0"
I20260812 11:17:44.044371 28115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:44.059023 28115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:44.064864 28115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:44.065246 28115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:44.066526 28115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:44.068109 28115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:44.068252 28115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:44.068398 28115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:44.068493 28115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:44.105376 28115 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:43667
I20260812 11:17:44.105476 28326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:43667 every 8 connection(s)
I20260812 11:17:44.107019 28115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:44.107615 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 28115
Aug 12 11:17:44 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533464, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.252@KRBTEST.COM
Aug 12 11:17:44 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533464, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
Aug 12 11:17:44 dist-test-slave-7kzw krb5kdc[26247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533464, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.253@KRBTEST.COM
I20260812 11:17:44.160086 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.110773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:51233 (local address 127.15.164.252:39769)
0812 11:17:44.130832 (+ 20059us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.130843 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.130864 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:17:44.130926 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.130931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.131008 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.131127 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.133999 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.135210 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.138484 (+ 3274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.139205 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.139319 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.147296 (+ 7977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.147308 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.147318 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.147382 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.152454 (+ 5072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.153686 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.153693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.153697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.153902 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.154908 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.154917 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.154922 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.155451 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.155629 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.159043 (+ 3414us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.159426 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19920,"thread_start_us":20477,"threads_started":1}
I20260812 11:17:44.161939 28334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.111734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.15.164.195:51233)
0812 11:17:44.121160 (+ 9426us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.121230 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.124856 (+ 3626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.131469 (+ 6613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.131474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.133463 (+ 1989us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:44.133789 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.133806 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.135416 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.135422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.138253 (+ 2831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.138270 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.139738 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.139750 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.140460 (+ 710us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.141193 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:44.141226 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:44.146875 (+ 5649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:44.152661 (+ 5786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.152672 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.152694 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.153482 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.154075 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.154083 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.154128 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.154729 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.155741 (+ 1012us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:44.155754 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:44.156574 (+ 820us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.157089 (+ 515us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.157878 (+ 789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9039,"mutex_wait_us":231,"thread_start_us":8719,"threads_started":1}
I20260812 11:17:44.165841 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.110970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:41383 (local address 127.15.164.254:39501)
0812 11:17:44.129712 (+ 18742us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.129721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.129751 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:17:44.129844 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.129853 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.129977 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.130350 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.133715 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.135049 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.138658 (+ 3609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.139417 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.139555 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.152410 (+ 12855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.152422 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.152430 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.152489 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.160802 (+ 8313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.161859 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.161865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.161869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.162034 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.162715 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.162721 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.162725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.163127 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.163364 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.164895 (+ 1531us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.165148 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18542,"thread_start_us":19179,"threads_started":1}
I20260812 11:17:44.166664 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.111731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:41383)
0812 11:17:44.125877 (+ 14146us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.125909 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.126083 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.130933 (+ 4850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.130948 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.132269 (+ 1321us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:44.133455 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.133484 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.135289 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.135297 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.138253 (+ 2956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.138270 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.139850 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.139857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.140173 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.141104 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:44.141153 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:44.151469 (+ 10316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:44.161110 (+ 9641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.161115 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.161120 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.161709 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.162336 (+ 627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.162343 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.162347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.162565 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.163450 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:44.163456 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:44.163652 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.163820 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.166209 (+ 2389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13945,"mutex_wait_us":650,"thread_start_us":13268,"threads_started":1}
I20260812 11:17:44.167865 28328 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39501
I20260812 11:17:44.168248 28328 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:44.169286 28328 heartbeater.cc:511] Master 127.15.164.254:39501 requested a full tablet report, sending...
I20260812 11:17:44.170225 28327 heartbeater.cc:347] Connected to a master server at 127.15.164.252:39769
I20260812 11:17:44.170373 28327 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:44.171062 28327 heartbeater.cc:511] Master 127.15.164.252:39769 requested a full tablet report, sending...
I20260812 11:17:44.173720 26316 ts_manager.cc:194] Re-registered known tserver with Master: d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667)
I20260812 11:17:44.174285 27579 ts_manager.cc:194] Registered new tserver with Master: d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667)
I20260812 11:17:44.175082 26316 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:41383
I20260812 11:17:44.175652 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.113328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.15.164.195:53225)
0812 11:17:44.133039 (+ 19711us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.133062 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.133223 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.134417 (+ 1194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.134425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.135248 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:44.135810 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.135830 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.138156 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.138164 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.141274 (+ 3110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.141296 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.148266 (+ 6970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.148279 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.149478 (+ 1199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.150810 (+ 1332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:44.150843 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:44.154079 (+ 3236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:44.163334 (+ 9255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.163343 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.163347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.163946 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.170569 (+ 6623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:44.170576 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:44.170584 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:44.170892 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:44.174242 (+ 3350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:44.174248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:44.174453 (+ 205us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.174646 (+ 193us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.175125 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19572,"thread_start_us":19442,"threads_started":1}
I20260812 11:17:44.176703 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.113915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:53225 (local address 127.15.164.253:34165)
0812 11:17:44.132522 (+ 18607us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.132530 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.133267 (+ 737us) server_negotiation.cc:407] Connection header received
0812 11:17:44.133372 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.133381 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.133519 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.133675 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.136071 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.137549 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.141495 (+ 3946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.142260 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.142419 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.154368 (+ 11949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.154379 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.154387 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.154495 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.158931 (+ 4436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.164120 (+ 5189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.164127 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.164131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.164512 (+ 381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.171905 (+ 7393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.171913 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.171918 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.172402 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.172591 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.176004 (+ 3413us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.176320 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18459,"thread_start_us":18345,"threads_started":1}
I20260812 11:17:44.177717 28329 heartbeater.cc:347] Connected to a master server at 127.15.164.253:34165
I20260812 11:17:44.177870 28329 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:44.178354 28329 heartbeater.cc:511] Master 127.15.164.253:34165 requested a full tablet report, sending...
I20260812 11:17:44.180204 27264 ts_manager.cc:194] Registered new tserver with Master: d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667)
I20260812 11:17:44.189548 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.151603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54334 (local address 127.15.164.252:39769)
0812 11:17:44.160356 (+ 8753us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.160362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.168676 (+ 8314us) server_negotiation.cc:407] Connection header received
0812 11:17:44.168984 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.168992 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.169117 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.169192 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.172394 (+ 3202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.173541 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.177156 (+ 3615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.178015 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.178186 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.182560 (+ 4374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.182570 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.182576 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.182622 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.186139 (+ 3517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.187097 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.187104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.187107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.187282 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.187716 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.187721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.187724 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.188038 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.188352 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.188773 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.189032 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8648,"thread_start_us":14216,"threads_started":1}
I20260812 11:17:44.191089 28348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.142362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40148 (local address 127.15.164.253:34165)
0812 11:17:44.152927 (+ 10565us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.152934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.165762 (+ 12828us) server_negotiation.cc:407] Connection header received
0812 11:17:44.166357 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.166364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.166456 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.166579 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.169770 (+ 3191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.171153 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.173496 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.174199 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.174319 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.182980 (+ 8661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.182989 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.182995 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.183042 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.187314 (+ 4272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.188317 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.188323 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.188330 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.188513 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.189027 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.189036 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.189043 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.189465 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.189684 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.190335 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.190630 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10404,"thread_start_us":12155,"threads_started":1}
I20260812 11:17:44.195019 28346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.142244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41050 (local address 127.15.164.254:39501)
0812 11:17:44.156118 (+ 13874us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.156124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.156144 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:44.156230 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.156235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.171134 (+ 14899us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.171269 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.176057 (+ 4788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.176909 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.180402 (+ 3493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.181094 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.182975 (+ 1881us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.187234 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.187243 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.187248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.187312 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.191178 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.192416 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.192422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.192426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.192593 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.193087 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.193090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.193093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.193395 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.193597 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.194250 (+ 653us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.194561 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13734,"thread_start_us":18672,"threads_started":1}
I20260812 11:17:44.199961 26316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:44.209507 26316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:44.255867 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.232824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41466 (local address 127.15.164.194:41295)
0812 11:17:44.245292 (+ 12468us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.245308 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.245357 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:17:44.245523 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.245536 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.245934 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.247863 (+ 1929us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:44.248092 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.249722 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.253102 (+ 3380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.254677 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.254868 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.255086 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.255379 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.255560 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12174,"thread_start_us":13402,"threads_started":1}
I20260812 11:17:44.255935 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.232629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:41295 (local address 127.0.0.1:41466)
0812 11:17:44.234116 (+ 1487us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.234143 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.234313 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.246651 (+ 12338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.246662 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.246718 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:44.247437 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.247468 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.250657 (+ 3189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.250664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.252888 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.252905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.254913 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.254926 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.255133 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.255198 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.255310 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.255474 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1271,"mutex_wait_us":22,"thread_start_us":17432,"threads_started":1}
I20260812 11:17:44.258698 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.233920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54726 (local address 127.15.164.195:43667)
0812 11:17:44.235256 (+ 1336us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.235270 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.249215 (+ 13945us) server_negotiation.cc:407] Connection header received
0812 11:17:44.249530 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.249540 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.249853 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.250066 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:44.251190 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.253008 (+ 1818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.255475 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.257195 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.257346 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.257528 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.258150 (+ 622us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.258343 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1082,"thread_start_us":1721,"threads_started":1}
I20260812 11:17:44.259474 28381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.232979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:43667 (local address 127.0.0.1:54726)
0812 11:17:44.249065 (+ 16086us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.249088 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.249340 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.250446 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.250451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.250511 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:44.250980 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.250989 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.253195 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.253200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.255310 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.255325 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.257732 (+ 2407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.257738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.257901 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.257931 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.258999 (+ 1068us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.259163 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15935,"thread_start_us":1264,"threads_started":1}
I20260812 11:17:44.260615 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.235440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:42397 (local address 127.0.0.1:60214)
0812 11:17:44.250428 (+ 14988us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.250446 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.250598 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.251298 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.251302 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.251354 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:44.251843 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.251858 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.253950 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.253956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.256528 (+ 2572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.256542 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.259752 (+ 3210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.259759 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.259979 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.260010 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.260094 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.260235 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14833,"mutex_wait_us":1,"thread_start_us":13288,"threads_started":1}
I20260812 11:17:44.260871 27980 tablet_service.cc:1467] Processing CreateTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f (DEFAULT_TABLE table=test-table [id=a80544ee2ef1406c9309c4fee24beaa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:44.261754 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.235743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60214 (local address 127.15.164.193:42397)
0812 11:17:44.248278 (+ 12535us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.248287 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.250588 (+ 2301us) server_negotiation.cc:407] Connection header received
0812 11:17:44.250787 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.250795 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.251067 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.251305 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:44.252164 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.253744 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.256842 (+ 3098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.259424 (+ 2582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.260809 (+ 1385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.261204 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.261284 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.261456 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12304,"thread_start_us":12541,"threads_started":1}
I20260812 11:17:44.262492 27980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b068c5f671d4bc28edd5f55596aca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:44.263221 28222 tablet_service.cc:1467] Processing CreateTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f (DEFAULT_TABLE table=test-table [id=a80544ee2ef1406c9309c4fee24beaa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:44.264582 28222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b068c5f671d4bc28edd5f55596aca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:44.265095 27757 tablet_service.cc:1467] Processing CreateTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f (DEFAULT_TABLE table=test-table [id=a80544ee2ef1406c9309c4fee24beaa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:44.266259 27757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b068c5f671d4bc28edd5f55596aca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:44.279872 28383 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Bootstrap starting.
I20260812 11:17:44.283596 28385 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Bootstrap starting.
I20260812 11:17:44.284121 28383 tablet_bootstrap.cc:654] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:44.285643 28386 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Bootstrap starting.
I20260812 11:17:44.286339 28383 log.cc:824] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:44.287597 28385 tablet_bootstrap.cc:654] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:44.289546 28385 log.cc:824] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:44.290042 28386 tablet_bootstrap.cc:654] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:44.291607 28386 log.cc:824] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:44.293581 28385 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: No bootstrap required, opened a new log
I20260812 11:17:44.293634 28383 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: No bootstrap required, opened a new log
I20260812 11:17:44.293932 28385 ts_tablet_manager.cc:1397] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260812 11:17:44.293963 28383 ts_tablet_manager.cc:1397] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260812 11:17:44.294852 28386 tablet_bootstrap.cc:492] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: No bootstrap required, opened a new log
I20260812 11:17:44.295122 28386 ts_tablet_manager.cc:1397] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260812 11:17:44.303463 28385 raft_consensus.cc:348] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.303925 28385 raft_consensus.cc:374] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:44.304021 28385 raft_consensus.cc:729] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4301cfc3431a4d6ab30c5379c4236ba1, State: Initialized, Role: FOLLOWER
I20260812 11:17:44.304702 28385 consensus_queue.cc:260] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.305833 28383 raft_consensus.cc:348] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.306545 28383 raft_consensus.cc:374] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:44.306125 28386 raft_consensus.cc:348] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.306679 28383 raft_consensus.cc:729] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17e6c3b934d42fc81189e8b10f19221, State: Initialized, Role: FOLLOWER
I20260812 11:17:44.306807 28386 raft_consensus.cc:374] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:44.306901 28386 raft_consensus.cc:729] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7428ac391d4ecf923862889b8c0c4f, State: Initialized, Role: FOLLOWER
I20260812 11:17:44.307504 28383 consensus_queue.cc:260] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.307767 28386 consensus_queue.cc:260] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.313324 28385 ts_tablet_manager.cc:1428] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Time spent starting tablet: real 0.019s user 0.020s sys 0.000s
I20260812 11:17:44.313426 28386 ts_tablet_manager.cc:1428] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Time spent starting tablet: real 0.018s user 0.009s sys 0.008s
I20260812 11:17:44.322717 28094 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
I20260812 11:17:44.328181 28328 heartbeater.cc:503] Master 127.15.164.254:39501 was elected leader, sending a full tablet report...
I20260812 11:17:44.330075 28383 ts_tablet_manager.cc:1428] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Time spent starting tablet: real 0.036s user 0.033s sys 0.000s
W20260812 11:17:44.368160 28339 tablet.cc:2369] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:17:44.388898 28096 tablet.cc:2369] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:44.390944 28395 raft_consensus.cc:482] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:44.391407 28395 raft_consensus.cc:504] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.393769 28395 leader_election.cc:288] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295), 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:44.400532 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.394145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:54169 (local address 127.15.164.194:41295)
0812 11:17:44.395008 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.395023 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.395043 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:44.395113 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.395117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.395247 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.395368 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:44.395870 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.396671 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.398669 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.399491 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.399673 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.399756 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.400116 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.400260 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260812 11:17:44.400633 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.394100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:41295 (local address 127.15.164.195:54169)
0812 11:17:44.394655 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.394679 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.394858 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.395417 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.395425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.395456 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:44.395672 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.395684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.396850 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.396857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.398438 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.398453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.399675 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.399681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.399922 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.399948 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.400083 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.400242 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":102,"spinlock_wait_cycles":11008}
I20260812 11:17:44.400990 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.394611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:54459 (local address 127.15.164.193:42397)
0812 11:17:44.394856 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.394862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.394886 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:17:44.394972 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.394977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.395047 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.395178 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:44.395608 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.396327 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.398608 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.399710 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.399931 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.400014 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.400351 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.400509 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:17:44.401049 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.394088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:42397 (local address 127.15.164.195:54459)
0812 11:17:44.394628 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:44.394679 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:44.394853 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:44.395196 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:44.395202 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:44.395226 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:44.395435 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.395445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.396473 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.396478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.398339 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:44.398359 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.399935 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.399942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:44.400165 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.400194 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:17:44.400320 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 11:17:44.400478 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":135,"spinlock_wait_cycles":20480}
I20260812 11:17:44.401966 28011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b068c5f671d4bc28edd5f55596aca9f" candidate_uuid: "d17e6c3b934d42fc81189e8b10f19221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" is_pre_election: true
I20260812 11:17:44.402415 27786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b068c5f671d4bc28edd5f55596aca9f" candidate_uuid: "d17e6c3b934d42fc81189e8b10f19221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7428ac391d4ecf923862889b8c0c4f" is_pre_election: true
I20260812 11:17:44.402722 28011 raft_consensus.cc:2454] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17e6c3b934d42fc81189e8b10f19221 in term 0.
I20260812 11:17:44.403292 27786 raft_consensus.cc:2454] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d17e6c3b934d42fc81189e8b10f19221 in term 0.
I20260812 11:17:44.403786 28142 leader_election.cc:302] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4301cfc3431a4d6ab30c5379c4236ba1, d17e6c3b934d42fc81189e8b10f19221; no voters:
I20260812 11:17:44.404403 28395 raft_consensus.cc:2781] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:44.404582 28395 raft_consensus.cc:482] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:44.404698 28395 raft_consensus.cc:3037] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:44.408598 28395 raft_consensus.cc:504] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.409816 28395 leader_election.cc:288] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [CANDIDATE]: Term 1 election: Requested vote from peers 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295), 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
W20260812 11:17:44.410116 27869 tablet.cc:2369] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:44.410441 28011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b068c5f671d4bc28edd5f55596aca9f" candidate_uuid: "d17e6c3b934d42fc81189e8b10f19221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4301cfc3431a4d6ab30c5379c4236ba1"
I20260812 11:17:44.410537 27786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b068c5f671d4bc28edd5f55596aca9f" candidate_uuid: "d17e6c3b934d42fc81189e8b10f19221" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7428ac391d4ecf923862889b8c0c4f"
I20260812 11:17:44.410706 28011 raft_consensus.cc:3037] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:44.410765 27786 raft_consensus.cc:3037] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:44.413421 27786 raft_consensus.cc:2454] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17e6c3b934d42fc81189e8b10f19221 in term 1.
I20260812 11:17:44.414000 28147 leader_election.cc:302] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a7428ac391d4ecf923862889b8c0c4f, d17e6c3b934d42fc81189e8b10f19221; no voters:
I20260812 11:17:44.414562 28395 raft_consensus.cc:2781] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:44.414726 28011 raft_consensus.cc:2454] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d17e6c3b934d42fc81189e8b10f19221 in term 1.
I20260812 11:17:44.421803 28395 raft_consensus.cc:686] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 1 LEADER]: Becoming Leader. State: Replica: d17e6c3b934d42fc81189e8b10f19221, State: Running, Role: LEADER
I20260812 11:17:44.422588 28395 consensus_queue.cc:237] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:44.428748 26315 catalog_manager.cc:5495] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 reported cstate change: term changed from 0 to 1, leader changed from <none> to d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195). New cstate: current_term: 1 leader_uuid: "d17e6c3b934d42fc81189e8b10f19221" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } health_report { overall_health: UNKNOWN } } }
I20260812 11:17:44.454761 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.449152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54738 (local address 127.15.164.195:43667)
0812 11:17:44.449342 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.449346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.449366 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:44.449515 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.449519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.449622 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.449779 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:44.450258 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.451132 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.452522 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.452929 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.453027 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.453528 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:44.454092 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:44.454212 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.454409 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.454527 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:17:44.464180 28011 raft_consensus.cc:1261] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Refusing update from remote peer d17e6c3b934d42fc81189e8b10f19221: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:44.464196 27786 raft_consensus.cc:1261] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Refusing update from remote peer d17e6c3b934d42fc81189e8b10f19221: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:44.465204 28397 consensus_queue.cc:1035] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:44.465627 28395 consensus_queue.cc:1035] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:44.498687 28409 mvcc.cc:205] Tried to move back new op lower bound from 7317641070434041856 to 7317641070279938048. Current Snapshot: MvccSnapshot[applied={T|T < 7317641070434041856 or (T in {7317641070434041856})}]
I20260812 11:17:44.501027 26316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:44.501351 26316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:44.509848 26316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31479e69a16d48c7a0da920ac3fa5262: Sending DeleteTablet for 3 replicas of tablet 5b068c5f671d4bc28edd5f55596aca9f
I20260812 11:17:44.511435 28222 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:44 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:54726
I20260812 11:17:44.511611 27757 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:44 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:60214
I20260812 11:17:44.512102 27980 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b068c5f671d4bc28edd5f55596aca9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:44 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:41466
I20260812 11:17:44.521360 28425 tablet_replica.cc:330] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: stopping tablet replica
I20260812 11:17:44.521983 28425 raft_consensus.cc:2229] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:44.522758 28425 raft_consensus.cc:2258] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:44.525863 28423 tablet_replica.cc:330] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: stopping tablet replica
I20260812 11:17:44.526369 28423 raft_consensus.cc:2229] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:44.527058 28423 raft_consensus.cc:2258] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:44.528591 28425 ts_tablet_manager.cc:1905] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:44.529588 28423 ts_tablet_manager.cc:1905] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:44.530938 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 26266
I20260812 11:17:44.532289 26356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:44.538667 28423 ts_tablet_manager.cc:1918] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:44.538897 28423 log.cc:1196] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/5b068c5f671d4bc28edd5f55596aca9f
I20260812 11:17:44.539551 28423 ts_tablet_manager.cc:1939] T 5b068c5f671d4bc28edd5f55596aca9f P 8a7428ac391d4ecf923862889b8c0c4f: Deleting consensus metadata
I20260812 11:17:44.543594 28422 tablet_replica.cc:330] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: stopping tablet replica
I20260812 11:17:44.545750 28422 raft_consensus.cc:2229] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:44.546420 28425 ts_tablet_manager.cc:1918] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:44.546818 28425 log.cc:1196] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/5b068c5f671d4bc28edd5f55596aca9f
I20260812 11:17:44.547494 28425 ts_tablet_manager.cc:1939] T 5b068c5f671d4bc28edd5f55596aca9f P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting consensus metadata
I20260812 11:17:44.548971 28422 raft_consensus.cc:2258] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:44.564157 28348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.515222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40150 (local address 127.15.164.253:34165)
0812 11:17:44.515531 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.515595 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.528684 (+ 13089us) server_negotiation.cc:407] Connection header received
0812 11:17:44.530585 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.530595 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.530718 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.530834 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.545083 (+ 14249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.546270 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.551375 (+ 5105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.552306 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.552459 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.556442 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.556448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.556451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.556490 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.559773 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.560781 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.560788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.560800 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.561033 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.561737 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.561746 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.561750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.562246 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.562578 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.563156 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.563439 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:17:44.564284 28422 ts_tablet_manager.cc:1905] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:44.572474 28422 ts_tablet_manager.cc:1918] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:44.572721 28422 log.cc:1196] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/5b068c5f671d4bc28edd5f55596aca9f
I20260812 11:17:44.573503 28422 ts_tablet_manager.cc:1939] T 5b068c5f671d4bc28edd5f55596aca9f P d17e6c3b934d42fc81189e8b10f19221: Deleting consensus metadata
I20260812 11:17:44.580041 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.529396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.15.164.252:39769)
0812 11:17:44.529595 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.529601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.563940 (+ 34339us) server_negotiation.cc:407] Connection header received
0812 11:17:44.564227 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.564236 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.564345 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.564419 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.566450 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.567297 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.568659 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.569079 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.569225 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.572699 (+ 3474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.572706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.572712 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.572761 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.576668 (+ 3907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.577651 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.577657 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.577661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.577905 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.578375 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.578381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.578385 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.578816 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.579064 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.579437 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.579668 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:17:44.687288 26294 catalog_manager.cc:4841] TS 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295): tablet 5b068c5f671d4bc28edd5f55596aca9f (table test-table [id=a80544ee2ef1406c9309c4fee24beaa4]) successfully deleted
W20260812 11:17:44.687904 26294 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.164.194:41295, user_credentials={real_user=slave}} blocked reactor thread for 136101us
I20260812 11:17:44.688310 26296 catalog_manager.cc:4841] TS 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397): tablet 5b068c5f671d4bc28edd5f55596aca9f (table test-table [id=a80544ee2ef1406c9309c4fee24beaa4]) successfully deleted
W20260812 11:17:44.688494 26296 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.164.193:42397, user_credentials={real_user=slave}} blocked reactor thread for 145932us
I20260812 11:17:44.688694 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 26266
I20260812 11:17:44.766155 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.741019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54358 (local address 127.15.164.252:39769)
0812 11:17:44.741391 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.741398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.746578 (+ 5180us) server_negotiation.cc:407] Connection header received
0812 11:17:44.747292 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.747302 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.747429 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.747528 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.751073 (+ 3545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.752310 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.754147 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.754716 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.754891 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.758682 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.758692 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.758700 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.758760 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.762431 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.763319 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.763326 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.763330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.763502 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.763964 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.763972 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.763978 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.764618 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.764938 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.765342 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.765789 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260812 11:17:44.767510 28348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:44.741241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40154 (local address 127.15.164.253:34165)
0812 11:17:44.741434 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:44.741443 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:44.750048 (+ 8605us) server_negotiation.cc:407] Connection header received
0812 11:17:44.750398 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:44.750406 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:44.750524 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:44.750601 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:44.753469 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.754642 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.756360 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:44.756794 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:44.756887 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:44.760623 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:44.760630 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:44.760634 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:44.760690 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:44.764208 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.765089 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.765094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.765097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.765279 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:44.765750 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:44.765756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:44.765761 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:44.766075 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:44.766336 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:44.766795 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 11:17:44.767113 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:17:45.487731 28441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:45.486821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:46001)
0812 11:17:45.487403 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:45.487535 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":314,"threads_started":1}
W20260812 11:17:45.488382 28094 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:39501 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:45.490401 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:45.489222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:44731)
0812 11:17:45.490045 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:45.490169 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":431,"threads_started":1}
W20260812 11:17:45.490944 28328 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:39501 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:45.495203 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:45.493874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:47781)
0812 11:17:45.494592 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:45.494755 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":442,"threads_started":1}
W20260812 11:17:45.495705 27867 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:39501 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.009536 28445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 31479e69a16d48c7a0da920ac3fa5262)
I20260812 11:17:46.010001 28445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } }
I20260812 11:17:46.010775 28446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 31479e69a16d48c7a0da920ac3fa5262)
I20260812 11:17:46.011081 28446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } }
I20260812 11:17:46.011897 28445 leader_election.cc:288] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501), 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253:34165)
I20260812 11:17:46.013598 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.012225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41480)
0812 11:17:46.013081 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.013294 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":305,"threads_started":1}
W20260812 11:17:46.013870 27555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.019189 28446 leader_election.cc:288] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501), 734d3e36c17b48a5b3f4cc14d09fffd0 (127.15.164.252:39769)
I20260812 11:17:46.020727 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.019933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41492)
0812 11:17:46.020322 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.020462 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260812 11:17:46.021104 27555 leader_election.cc:334] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501): Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.021431 28454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.014100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41484)
0812 11:17:46.020554 (+ 6454us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.021087 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6261,"thread_start_us":4350,"threads_started":1}
W20260812 11:17:46.021754 27242 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.025116 28454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.024618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41496)
0812 11:17:46.024825 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.024935 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 11:17:46.025363 27242 leader_election.cc:334] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501): Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.028718 28451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.012242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40156 (local address 127.15.164.253:34165)
0812 11:17:46.016471 (+ 4229us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.016477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.016497 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:17:46.016563 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.016568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.016648 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.017785 (+ 1137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.018221 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.023999 (+ 5778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.026545 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.027504 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.027726 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.027820 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.028136 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.028298 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":4087,"thread_start_us":3929,"threads_started":1}
I20260812 11:17:46.028805 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.012195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:34165 (local address 127.0.0.1:40156)
0812 11:17:46.012878 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.012911 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.013090 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.016842 (+ 3752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.016850 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.016883 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.017464 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.017494 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.024217 (+ 6723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.024222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.026339 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.026355 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.027702 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.027711 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.027934 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.027963 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.028092 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.028324 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":47,"thread_start_us":630,"threads_started":1}
I20260812 11:17:46.029811 27279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" is_pre_election: true
I20260812 11:17:46.030324 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.019366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54370 (local address 127.15.164.252:39769)
0812 11:17:46.022149 (+ 2783us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.022154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.022176 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:17:46.022246 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.022250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.022310 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.022452 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.023839 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.025791 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.027877 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.029065 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.029270 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.029356 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.029824 (+ 468us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.029938 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":2682,"thread_start_us":2498,"threads_started":1}
I20260812 11:17:46.030392 27279 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 734d3e36c17b48a5b3f4cc14d09fffd0 in term 1.
I20260812 11:17:46.030694 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.019314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:39769 (local address 127.0.0.1:54370)
0812 11:17:46.021909 (+ 2595us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.021931 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.022100 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.022501 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.022511 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.022550 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.023553 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.023577 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.025944 (+ 2367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.025953 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.027689 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.027702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.029270 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.029279 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.029529 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.029569 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.029689 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.029921 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2373,"mutex_wait_us":1,"thread_start_us":851,"threads_started":1}
I20260812 11:17:46.031153 27558 leader_election.cc:302] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3278bcd67db74c6f9095c6f25bcf03d6, 734d3e36c17b48a5b3f4cc14d09fffd0; no voters: 31479e69a16d48c7a0da920ac3fa5262
I20260812 11:17:46.031733 28445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 11:17:46.031900 28445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 31479e69a16d48c7a0da920ac3fa5262)
I20260812 11:17:46.032074 28445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:17:46.032153 27596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" is_pre_election: true
I20260812 11:17:46.035856 28445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } }
I20260812 11:17:46.036516 27596 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3278bcd67db74c6f9095c6f25bcf03d6 in current term 2: Already voted for candidate 734d3e36c17b48a5b3f4cc14d09fffd0 in this term.
I20260812 11:17:46.036777 28445 leader_election.cc:288] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 election: Requested vote from peers 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501), 3278bcd67db74c6f9095c6f25bcf03d6 (127.15.164.253:34165)
I20260812 11:17:46.037889 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.036993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41510)
0812 11:17:46.037285 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.037387 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260812 11:17:46.038311 27279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3278bcd67db74c6f9095c6f25bcf03d6"
I20260812 11:17:46.038455 27245 leader_election.cc:302] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3278bcd67db74c6f9095c6f25bcf03d6; no voters: 31479e69a16d48c7a0da920ac3fa5262, 734d3e36c17b48a5b3f4cc14d09fffd0
I20260812 11:17:46.038676 27279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:17:46.039244 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.038721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41520)
0812 11:17:46.038966 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.039064 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
W20260812 11:17:46.039417 27555 leader_election.cc:334] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501): Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
I20260812 11:17:46.041450 27279 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 734d3e36c17b48a5b3f4cc14d09fffd0 in term 2.
I20260812 11:17:46.041867 28446 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:17:46.042375 27558 leader_election.cc:302] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3278bcd67db74c6f9095c6f25bcf03d6, 734d3e36c17b48a5b3f4cc14d09fffd0; no voters: 31479e69a16d48c7a0da920ac3fa5262
I20260812 11:17:46.042829 28445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:17:46.043646 28445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [term 2 LEADER]: Becoming Leader. State: Replica: 734d3e36c17b48a5b3f4cc14d09fffd0, State: Running, Role: LEADER
I20260812 11:17:46.044260 28445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } }
I20260812 11:17:46.046458 28457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 734d3e36c17b48a5b3f4cc14d09fffd0. Latest consensus state: current_term: 2 leader_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:46.047065 28457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:46.047971 28459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:46.053288 28459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:46.054234 28459 catalog_manager.cc:1259] Loaded cluster ID: a5b6c07957d04f38b104b4bf378c1b55
I20260812 11:17:46.054318 28459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:46.055573 28459 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:46.056838 28459 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Loaded TSK: 0
I20260812 11:17:46.058178 28459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:17:46.074512 27579 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54358:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:46.082175 27579 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:46.087106 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.086675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41538)
0812 11:17:46.086863 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.086962 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:17:46.087246 27279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [term 2 FOLLOWER]: Refusing update from remote peer 734d3e36c17b48a5b3f4cc14d09fffd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 11:17:46.088219 28457 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 11:17:46.088382 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.087944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41544)
0812 11:17:46.088136 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.088218 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:17:46.088747 27555 consensus_peers.cc:487] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 -> Peer 31479e69a16d48c7a0da920ac3fa5262 (127.15.164.254:39501): Couldn't send request to peer 31479e69a16d48c7a0da920ac3fa5262. Status: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:17:46.091506 28446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 734d3e36c17b48a5b3f4cc14d09fffd0. Latest consensus state: current_term: 2 leader_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:46.091813 28446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:46.094219 28457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:46.094612 28457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:46.094937 28446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "31479e69a16d48c7a0da920ac3fa5262" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39501 } } peers { permanent_uuid: "3278bcd67db74c6f9095c6f25bcf03d6" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 34165 } attrs { promote: false } } peers { permanent_uuid: "734d3e36c17b48a5b3f4cc14d09fffd0" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 39769 } attrs { promote: false } } }
I20260812 11:17:46.095270 28446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3278bcd67db74c6f9095c6f25bcf03d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:17:46.119289 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.107456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:41295 (local address 127.0.0.1:41482)
0812 11:17:46.108027 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.108050 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.108186 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.112430 (+ 4244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.112435 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.112467 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.112918 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.112940 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.114735 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.114740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.116512 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.116531 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.118234 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.118241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.118489 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.118530 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.118614 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.118886 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409}
I20260812 11:17:46.120551 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.107972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41482 (local address 127.15.164.194:41295)
0812 11:17:46.112024 (+ 4052us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.112031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.112052 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:17:46.112146 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.112152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.112243 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.113172 (+ 929us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.113400 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.114542 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.116762 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.118023 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.119734 (+ 1711us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.119822 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.119884 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.120048 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3921,"thread_start_us":3801,"threads_started":1}
I20260812 11:17:46.121654 27980 tablet_service.cc:1467] Processing CreateTablet for tablet d948e814fed84296b3d9936dcc6fa6ce (DEFAULT_TABLE table=test-table [id=3a99945909c44a5c820f336973165537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:46.122438 27980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d948e814fed84296b3d9936dcc6fa6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:46.124096 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.108010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:43667 (local address 127.0.0.1:54748)
0812 11:17:46.108145 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.108162 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.108333 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.115664 (+ 7331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.115672 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.115726 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.116150 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.116167 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.117699 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.117706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.120116 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.120136 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.122751 (+ 2615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.122768 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.123400 (+ 632us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.123445 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.123560 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.123730 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 11:17:46.124923 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.108470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54748 (local address 127.15.164.195:43667)
0812 11:17:46.115260 (+ 6790us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.115267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.115290 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:17:46.115369 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.115374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.115467 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.115597 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.116355 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.117510 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.120527 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.122180 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.122642 (+ 462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.122780 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.124404 (+ 1624us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.124583 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6640,"thread_start_us":6522,"threads_started":1}
I20260812 11:17:46.125936 28222 tablet_service.cc:1467] Processing CreateTablet for tablet d948e814fed84296b3d9936dcc6fa6ce (DEFAULT_TABLE table=test-table [id=3a99945909c44a5c820f336973165537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:46.126437 28222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d948e814fed84296b3d9936dcc6fa6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:46.129815 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.110711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:42397 (local address 127.0.0.1:60218)
0812 11:17:46.111419 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.111437 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.111546 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.122010 (+ 10464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.122016 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.122053 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.122742 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.122762 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.124775 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.124780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.126416 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.126432 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.128541 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.128550 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.129074 (+ 524us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.129131 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.129224 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.129390 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":412,"threads_started":1}
I20260812 11:17:46.131001 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.110807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.15.164.193:42397)
0812 11:17:46.121464 (+ 10657us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.121471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.121496 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:17:46.121594 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.121600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.121687 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.121878 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.123210 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.124593 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.126652 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.128240 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.130276 (+ 2036us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.130375 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.130440 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.130647 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10404,"thread_start_us":10433,"threads_started":1}
I20260812 11:17:46.133582 28473 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Bootstrap starting.
I20260812 11:17:46.133594 27757 tablet_service.cc:1467] Processing CreateTablet for tablet d948e814fed84296b3d9936dcc6fa6ce (DEFAULT_TABLE table=test-table [id=3a99945909c44a5c820f336973165537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:46.134183 27757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d948e814fed84296b3d9936dcc6fa6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:46.134709 28474 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Bootstrap starting.
I20260812 11:17:46.135800 28473 tablet_bootstrap.cc:654] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:46.136941 28474 tablet_bootstrap.cc:654] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:46.138453 28473 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: No bootstrap required, opened a new log
I20260812 11:17:46.138731 28473 ts_tablet_manager.cc:1397] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:17:46.139729 28473 raft_consensus.cc:348] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.139973 28473 raft_consensus.cc:374] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:46.140216 28473 raft_consensus.cc:729] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17e6c3b934d42fc81189e8b10f19221, State: Initialized, Role: FOLLOWER
I20260812 11:17:46.140642 28473 consensus_queue.cc:260] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.141767 28473 ts_tablet_manager.cc:1428] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:46.145470 28480 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Bootstrap starting.
I20260812 11:17:46.146482 28327 heartbeater.cc:503] Master 127.15.164.252:39769 was elected leader, sending a full tablet report...
I20260812 11:17:46.150708 28480 tablet_bootstrap.cc:654] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:46.152529 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.142433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:60501)
0812 11:17:46.151966 (+ 9533us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.152202 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9388,"thread_start_us":9192,"threads_started":1}
I20260812 11:17:46.153911 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.153390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:57137)
0812 11:17:46.153661 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.153764 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260812 11:17:46.154852 28480 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: No bootstrap required, opened a new log
I20260812 11:17:46.154860 28474 tablet_bootstrap.cc:492] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: No bootstrap required, opened a new log
I20260812 11:17:46.155035 28474 ts_tablet_manager.cc:1397] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.011s
I20260812 11:17:46.155036 28480 ts_tablet_manager.cc:1397] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260812 11:17:46.155908 28480 raft_consensus.cc:348] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.155916 28474 raft_consensus.cc:348] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.156168 28474 raft_consensus.cc:374] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:46.156168 28480 raft_consensus.cc:374] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:46.156266 28480 raft_consensus.cc:729] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7428ac391d4ecf923862889b8c0c4f, State: Initialized, Role: FOLLOWER
I20260812 11:17:46.156266 28474 raft_consensus.cc:729] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4301cfc3431a4d6ab30c5379c4236ba1, State: Initialized, Role: FOLLOWER
I20260812 11:17:46.156582 28480 consensus_queue.cc:260] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.156620 28474 consensus_queue.cc:260] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.157882 28480 ts_tablet_manager.cc:1428] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:46.160262 27864 heartbeater.cc:503] Master 127.15.164.252:39769 was elected leader, sending a full tablet report...
I20260812 11:17:46.163769 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.159049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:48113)
0812 11:17:46.163109 (+ 4060us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.163343 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3882,"thread_start_us":3698,"threads_started":1}
I20260812 11:17:46.166427 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.164759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:40927)
0812 11:17:46.166138 (+ 1379us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.166242 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1264,"threads_started":1}
I20260812 11:17:46.175280 28474 ts_tablet_manager.cc:1428] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Time spent starting tablet: real 0.020s user 0.010s sys 0.010s
I20260812 11:17:46.178057 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.176509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:59367)
0812 11:17:46.177532 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.177719 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":839,"threads_started":1}
I20260812 11:17:46.179744 28092 heartbeater.cc:503] Master 127.15.164.252:39769 was elected leader, sending a full tablet report...
I20260812 11:17:46.180889 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.180299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:48185)
0812 11:17:46.180533 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.180643 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260812 11:17:46.408480 28485 raft_consensus.cc:482] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:46.408789 28485 raft_consensus.cc:504] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.411105 28485 leader_election.cc:288] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667), 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:46.420410 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.412356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:42509 (local address 127.15.164.193:42397)
0812 11:17:46.412619 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.412626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.413240 (+ 614us) server_negotiation.cc:407] Connection header received
0812 11:17:46.413772 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.413780 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.413859 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.413973 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.414712 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.415700 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.417979 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.419279 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.419455 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.419552 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.419988 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.420146 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:17:46.420518 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.411656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:47651 (local address 127.15.164.195:43667)
0812 11:17:46.411857 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.411864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.411890 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:17:46.412641 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.412652 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.412789 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.412875 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:46.414214 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.415237 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.418118 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.419397 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.419536 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.419629 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.420118 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.420272 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:17:46.420619 28491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.411968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:42397 (local address 127.15.164.194:42509)
0812 11:17:46.413087 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.413106 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.413561 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.414009 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.414018 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.414046 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.414533 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.414546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.415871 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.415876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.417812 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.417828 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.419510 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.419517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.419776 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.419819 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.419936 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.420095 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":982,"mutex_wait_us":25,"thread_start_us":831,"threads_started":1}
I20260812 11:17:46.421494 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.411509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:43667 (local address 127.15.164.194:47651)
0812 11:17:46.411734 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.411771 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:46.411927 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:46.413114 (+ 1187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:46.413117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:46.413212 (+ 95us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:46.413973 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.413988 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.415395 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.415401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.417931 (+ 2530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:46.417948 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.419741 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.419746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:46.419885 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.419943 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 11:17:46.421017 (+ 1074us) client_negotiation.cc:240] Negotiation successful
0812 11:17:46.421192 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":44,"spinlock_wait_cycles":858368}
I20260812 11:17:46.421532 27786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d948e814fed84296b3d9936dcc6fa6ce" candidate_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7428ac391d4ecf923862889b8c0c4f" is_pre_election: true
I20260812 11:17:46.421835 27786 raft_consensus.cc:2454] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4301cfc3431a4d6ab30c5379c4236ba1 in term 0.
I20260812 11:17:46.422554 27913 leader_election.cc:302] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4301cfc3431a4d6ab30c5379c4236ba1, 8a7428ac391d4ecf923862889b8c0c4f; no voters:
I20260812 11:17:46.422830 28258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d948e814fed84296b3d9936dcc6fa6ce" candidate_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17e6c3b934d42fc81189e8b10f19221" is_pre_election: true
I20260812 11:17:46.423031 28485 raft_consensus.cc:2781] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:46.423144 28485 raft_consensus.cc:482] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:46.423241 28485 raft_consensus.cc:3037] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:46.423323 28258 raft_consensus.cc:2454] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4301cfc3431a4d6ab30c5379c4236ba1 in term 0.
I20260812 11:17:46.426872 28485 raft_consensus.cc:504] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.427764 28485 leader_election.cc:288] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [CANDIDATE]: Term 1 election: Requested vote from peers d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667), 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397)
I20260812 11:17:46.428793 28258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d948e814fed84296b3d9936dcc6fa6ce" candidate_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d17e6c3b934d42fc81189e8b10f19221"
I20260812 11:17:46.429039 28258 raft_consensus.cc:3037] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:46.429426 27786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d948e814fed84296b3d9936dcc6fa6ce" candidate_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7428ac391d4ecf923862889b8c0c4f"
I20260812 11:17:46.429702 27786 raft_consensus.cc:3037] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:46.431643 28258 raft_consensus.cc:2454] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4301cfc3431a4d6ab30c5379c4236ba1 in term 1.
I20260812 11:17:46.432507 27913 leader_election.cc:302] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4301cfc3431a4d6ab30c5379c4236ba1, d17e6c3b934d42fc81189e8b10f19221; no voters:
I20260812 11:17:46.432746 27786 raft_consensus.cc:2454] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4301cfc3431a4d6ab30c5379c4236ba1 in term 1.
I20260812 11:17:46.433099 28485 raft_consensus.cc:2781] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:46.434031 28485 raft_consensus.cc:686] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 LEADER]: Becoming Leader. State: Replica: 4301cfc3431a4d6ab30c5379c4236ba1, State: Running, Role: LEADER
I20260812 11:17:46.434695 28485 consensus_queue.cc:237] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } }
I20260812 11:17:46.436024 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.435285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:51553)
0812 11:17:46.435675 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.435819 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:17:46.439177 27578 catalog_manager.cc:5495] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4301cfc3431a4d6ab30c5379c4236ba1" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 41295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 } health_report { overall_health: UNKNOWN } } }
I20260812 11:17:46.502570 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.496534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41494 (local address 127.15.164.194:41295)
0812 11:17:46.496835 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.496842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.496865 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:17:46.497114 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.497119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.497229 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.497404 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:46.497804 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.498543 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.500107 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.500560 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.500713 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.501180 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:46.501855 (+ 675us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:46.502017 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.502123 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.502222 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 11:17:46.507720 27786 raft_consensus.cc:1261] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Refusing update from remote peer 4301cfc3431a4d6ab30c5379c4236ba1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:46.508026 28258 raft_consensus.cc:1261] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Refusing update from remote peer 4301cfc3431a4d6ab30c5379c4236ba1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:46.508947 28492 consensus_queue.cc:1035] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7428ac391d4ecf923862889b8c0c4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:46.509510 28485 consensus_queue.cc:1035] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d17e6c3b934d42fc81189e8b10f19221" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 43667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:46.513320 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.512148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:53479)
0812 11:17:46.512839 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.513034 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478}
I20260812 11:17:46.513353 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.512431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:38247)
0812 11:17:46.512712 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.512991 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:17:46.520530 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.519886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.195:36785)
0812 11:17:46.520206 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.520322 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260812 11:17:46.521306 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.520692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:56737)
0812 11:17:46.520984 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.521091 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260812 11:17:46.524371 28497 mvcc.cc:205] Tried to move back new op lower bound from 7317641078805766144 to 7317641078521573376. Current Snapshot: MvccSnapshot[applied={T|T < 7317641078805766144 or (T in {7317641078805766144})}]
I20260812 11:17:46.529392 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.528785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.193:47175)
0812 11:17:46.529060 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.529171 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260812 11:17:46.531251 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.528800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.15.164.194:53405)
0812 11:17:46.530960 (+ 2160us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.531068 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2047}
I20260812 11:17:46.539845 27579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:46.540174 27579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:46.547785 27579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 734d3e36c17b48a5b3f4cc14d09fffd0: Sending DeleteTablet for 3 replicas of tablet d948e814fed84296b3d9936dcc6fa6ce
I20260812 11:17:46.548991 27980 tablet_service.cc:1514] Processing DeleteTablet for tablet d948e814fed84296b3d9936dcc6fa6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:46 UTC) from {username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:41482
I20260812 11:17:46.549234 28222 tablet_service.cc:1514] Processing DeleteTablet for tablet d948e814fed84296b3d9936dcc6fa6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:46 UTC) from {username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:54748
I20260812 11:17:46.550102 27757 tablet_service.cc:1514] Processing DeleteTablet for tablet d948e814fed84296b3d9936dcc6fa6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:46 UTC) from {username='oryx', principal='oryx/127.15.164.252@KRBTEST.COM'} at 127.0.0.1:60218
I20260812 11:17:46.554509 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 27550
I20260812 11:17:46.561179 28524 tablet_replica.cc:330] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: stopping tablet replica
I20260812 11:17:46.561672 28518 tablet_replica.cc:330] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: stopping tablet replica
I20260812 11:17:46.562083 28518 raft_consensus.cc:2229] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:46.562623 28524 raft_consensus.cc:2229] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:46.563516 28523 tablet_replica.cc:330] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: stopping tablet replica
I20260812 11:17:46.563501 28518 raft_consensus.cc:2258] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:46.563577 28524 raft_consensus.cc:2258] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:46.563840 28523 raft_consensus.cc:2229] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:46.564275 28523 raft_consensus.cc:2258] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:46.565299 28518 ts_tablet_manager.cc:1905] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:46.565775 28523 ts_tablet_manager.cc:1905] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:46.567224 28524 ts_tablet_manager.cc:1905] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:46.573616 28518 ts_tablet_manager.cc:1918] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:46.573764 28523 ts_tablet_manager.cc:1918] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:46.573932 28518 log.cc:1196] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/d948e814fed84296b3d9936dcc6fa6ce
I20260812 11:17:46.573976 28523 log.cc:1196] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/d948e814fed84296b3d9936dcc6fa6ce
I20260812 11:17:46.574535 28523 ts_tablet_manager.cc:1939] T d948e814fed84296b3d9936dcc6fa6ce P d17e6c3b934d42fc81189e8b10f19221: Deleting consensus metadata
I20260812 11:17:46.574790 28518 ts_tablet_manager.cc:1939] T d948e814fed84296b3d9936dcc6fa6ce P 4301cfc3431a4d6ab30c5379c4236ba1: Deleting consensus metadata
I20260812 11:17:46.576028 27558 catalog_manager.cc:4841] TS d17e6c3b934d42fc81189e8b10f19221 (127.15.164.195:43667): tablet d948e814fed84296b3d9936dcc6fa6ce (table test-table [id=3a99945909c44a5c820f336973165537]) successfully deleted
I20260812 11:17:46.576941 27552 catalog_manager.cc:4841] TS 4301cfc3431a4d6ab30c5379c4236ba1 (127.15.164.194:41295): tablet d948e814fed84296b3d9936dcc6fa6ce (table test-table [id=3a99945909c44a5c820f336973165537]) successfully deleted
I20260812 11:17:46.578135 28524 ts_tablet_manager.cc:1918] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:46.578332 28524 log.cc:1196] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/d948e814fed84296b3d9936dcc6fa6ce
I20260812 11:17:46.578848 28524 ts_tablet_manager.cc:1939] T d948e814fed84296b3d9936dcc6fa6ce P 8a7428ac391d4ecf923862889b8c0c4f: Deleting consensus metadata
I20260812 11:17:46.579965 27558 catalog_manager.cc:4841] TS 8a7428ac391d4ecf923862889b8c0c4f (127.15.164.193:42397): tablet d948e814fed84296b3d9936dcc6fa6ce (table test-table [id=3a99945909c44a5c820f336973165537]) successfully deleted
I20260812 11:17:46.595640 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.556546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60226 (local address 127.15.164.193:42397)
0812 11:17:46.556759 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.556766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.563185 (+ 6419us) server_negotiation.cc:407] Connection header received
0812 11:17:46.563547 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.563557 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.563668 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.563773 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:46.569671 (+ 5898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.570974 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.579883 (+ 8909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.580421 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.580512 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.587828 (+ 7316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:46.587855 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:46.587880 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:46.587938 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:46.592001 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.592963 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.592974 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.592979 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.593161 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.593573 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.593579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.593583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.594136 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:46.594526 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.594940 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.595233 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:17:46.596392 27856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:46.636656 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.635813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41554)
0812 11:17:46.636302 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.636416 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":246,"threads_started":1}
I20260812 11:17:46.638216 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.637774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41568)
0812 11:17:46.637952 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:46.638062 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 11:17:46.699987 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 27550
I20260812 11:17:46.730760 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 27879
I20260812 11:17:46.748517 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.731622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.15.164.194:41295)
0812 11:17:46.731813 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.731817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.731910 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:17:46.732191 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.732196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.732275 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.732371 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:46.734224 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.735140 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.736969 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.737396 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.737504 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.741523 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:46.741539 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:46.741558 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:46.741601 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:46.745300 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.746164 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.746173 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.746175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.746370 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.746847 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.746851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.746853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.747237 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:46.747554 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.747912 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.748105 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:17:46.749374 28083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:46.876001 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 27879
I20260812 11:17:46.907083 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 28115
I20260812 11:17:46.924028 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:46.908425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.15.164.195:43667)
0812 11:17:46.908775 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:46.908784 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:46.908960 (+ 176us) server_negotiation.cc:407] Connection header received
0812 11:17:46.909209 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:46.909214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:46.909284 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:46.909399 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:46.911030 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.911767 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.913106 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:46.913534 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:46.913682 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:46.917018 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:46.917036 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:46.917056 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:46.917102 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:46.920619 (+ 3517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.921433 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.921442 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.921445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.921605 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:46.922030 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:46.922036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:46.922039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:46.922523 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:46.922905 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:46.923301 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 11:17:46.923571 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260812 11:17:46.924985 28317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:47.056330 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 28115
I20260812 11:17:47.090705 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 27039
I20260812 11:17:47.091938 27312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:47.221866 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 27039
I20260812 11:17:47.246388 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:47.245471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41584)
0812 11:17:47.246096 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:47.246203 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":349,"threads_started":1}
I20260812 11:17:47.248093 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:47.247718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39501 (local address 127.0.0.1:41586)
0812 11:17:47.247877 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:47.247967 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:39501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:17:47.255991 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 27211
I20260812 11:17:47.257218 27623 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:47.386747 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 27211
2026-08-12T11:17:47Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11315 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:47 dist-test-slave-7kzw krb5kdc[28545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:47 dist-test-slave-7kzw krb5kdc[28545](info): set up 2 sockets
Aug 12 11:17:47 dist-test-slave-7kzw krb5kdc[28545](info): commencing operation
krb5kdc: starting...
W20260812 11:17:48.808054 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.359s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:48 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab.
Entry for principal oryx/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab.
I20260812 11:17:49.095551 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44015
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab
--principal=oryx/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:49.467144 28563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:49.467516 28563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:49.467669 28563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:49.475493 28563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:49.475623 28563 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:17:49.475695 28563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:49.475804 28563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:49.475943 28563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:49.476042 28563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:49.486759 28563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44015
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.254.keytab
--principal=oryx/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:49.488221 28563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:49.489637 28563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:49.503350 28571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:49.503270 28572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:49.503312 28563 server_base.cc:1034] running on GCE node
W20260812 11:17:49.503743 28577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:49.505208 28563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:49.507576 28563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:49.508869 28563 hybrid_clock.cc:648] HybridClock initialized: now 1786533469508813 us; error 71 us; skew 500 ppm
I20260812 11:17:49.509310 28563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:49 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:49.513031 28563 init.cc:377] Logged in from keytab as oryx/127.15.164.254@KRBTEST.COM (short username oryx)
I20260812 11:17:49.514883 28563 webserver.cc:460] Webserver started at http://127.15.164.254:38123/ using document root <none> and password file <none>
I20260812 11:17:49.515697 28563 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:49.515843 28563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:49.516222 28563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:49.519650 28563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "9deee6d2a217412f8237fa33573ade15"
format_stamp: "Formatted at 2026-08-12 11:17:49 on dist-test-slave-7kzw"
server_key: "cf6bc4b4e7c9b44346d51ca9b2aedf24"
server_key_iv: "65ce6235572f7576b7ed4ab3347c6d84"
server_key_version: "encryptionkey@0"
I20260812 11:17:49.520813 28563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "9deee6d2a217412f8237fa33573ade15"
format_stamp: "Formatted at 2026-08-12 11:17:49 on dist-test-slave-7kzw"
server_key: "cf6bc4b4e7c9b44346d51ca9b2aedf24"
server_key_iv: "65ce6235572f7576b7ed4ab3347c6d84"
server_key_version: "encryptionkey@0"
I20260812 11:17:49.527256 28563 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:17:49.531438 28587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:49.532953 28563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:17:49.533228 28563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "9deee6d2a217412f8237fa33573ade15"
format_stamp: "Formatted at 2026-08-12 11:17:49 on dist-test-slave-7kzw"
server_key: "cf6bc4b4e7c9b44346d51ca9b2aedf24"
server_key_iv: "65ce6235572f7576b7ed4ab3347c6d84"
server_key_version: "encryptionkey@0"
I20260812 11:17:49.533516 28563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:49.554056 28563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:49.559388 28563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:49.559703 28563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:49.585150 28563 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44015
I20260812 11:17:49.585186 28689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44015 every 8 connection(s)
I20260812 11:17:49.586792 28563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:49.590981 28690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:49.595942 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 28563
I20260812 11:17:49.596174 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:49.597061 16019 external_mini_cluster.cc:1428] Setting key e541ee9ecde39e696cff36839884f50e
I20260812 11:17:49.604103 28690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Bootstrap starting.
I20260812 11:17:49.608247 28690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:49.609561 28690 log.cc:824] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:49.613483 28690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: No bootstrap required, opened a new log
Aug 12 11:17:49 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:49.623479 28690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } }
I20260812 11:17:49.623973 28690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:49.624104 28690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9deee6d2a217412f8237fa33573ade15, State: Initialized, Role: FOLLOWER
I20260812 11:17:49.624595 28695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:49.599454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.15.164.254:44015)
0812 11:17:49.600869 (+ 1415us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:49.600883 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:49.600933 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:17:49.602954 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:49.602982 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:49.603399 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:49.603747 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:49.605664 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:49.607185 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:49.609076 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:49.609888 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:49.610041 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:49.615634 (+ 5593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:49.615647 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:49.615665 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:49.615716 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:49.619431 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:49.620393 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:49.620402 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:49.620409 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:49.620600 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:49.621042 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:49.621046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:49.621048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:49.621746 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:49.621992 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:49.622706 (+ 714us) server_negotiation.cc:299] Negotiation successful
0812 11:17:49.623218 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1154,"thread_start_us":559,"threads_started":1}
I20260812 11:17:49.624915 28690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } }
I20260812 11:17:49.625201 28690 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:49.625391 28690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:49.625608 28690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:49.628180 28690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } }
I20260812 11:17:49.628718 28690 leader_election.cc:302] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9deee6d2a217412f8237fa33573ade15; no voters:
I20260812 11:17:49.629343 28690 leader_election.cc:288] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:49.629501 28697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:49.630352 28697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [term 1 LEADER]: Becoming Leader. State: Replica: 9deee6d2a217412f8237fa33573ade15, State: Running, Role: LEADER
I20260812 11:17:49.630985 28697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } }
I20260812 11:17:49.631565 28690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:49.633803 28698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9deee6d2a217412f8237fa33573ade15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } } }
I20260812 11:17:49.634095 28700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9deee6d2a217412f8237fa33573ade15. Latest consensus state: current_term: 1 leader_uuid: "9deee6d2a217412f8237fa33573ade15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9deee6d2a217412f8237fa33573ade15" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44015 } } }
I20260812 11:17:49.634358 28698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:49.634414 28700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:49.638610 28703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:49.645890 28703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:49.655615 28703 catalog_manager.cc:1347] Generated new cluster ID: e550a4d148bd4026b836024cee404690
I20260812 11:17:49.655757 28703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:49.673202 28703 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:49.675345 28703 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:49.689131 28703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Generated new TSK 0
I20260812 11:17:49.690376 28703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
I20260812 11:17:49.765530 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44015
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:50.140105 28729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:50.140568 28729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:50.140719 28729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:50.148358 28729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:50.148481 28729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:50.148571 28729 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:17:50.148661 28729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:50.158942 28729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:50.160291 28729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:50.161626 28729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:50.176942 28736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:50.177045 28739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:50.177634 28735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:50.177954 28729 server_base.cc:1034] running on GCE node
I20260812 11:17:50.178840 28729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:50.180078 28729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:50.181380 28729 hybrid_clock.cc:648] HybridClock initialized: now 1786533470181270 us; error 68 us; skew 500 ppm
I20260812 11:17:50.181767 28729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:50 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:50.185290 28729 init.cc:377] Logged in from keytab as oryx/127.15.164.193@KRBTEST.COM (short username oryx)
I20260812 11:17:50.187008 28729 webserver.cc:460] Webserver started at http://127.15.164.193:38199/ using document root <none> and password file <none>
I20260812 11:17:50.187781 28729 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:50.187937 28729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:50.188298 28729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:50.191458 28729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "41908367f6f447769796945e4595fa35"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "0448c7f10214f44ad3dbe3ab69ebdd56"
server_key_iv: "6299efa9da2ace966892e14ff61a0dd8"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.192291 28729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "41908367f6f447769796945e4595fa35"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "0448c7f10214f44ad3dbe3ab69ebdd56"
server_key_iv: "6299efa9da2ace966892e14ff61a0dd8"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.197736 28729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:17:50.201736 28751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:50.203332 28729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:50.203540 28729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "41908367f6f447769796945e4595fa35"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "0448c7f10214f44ad3dbe3ab69ebdd56"
server_key_iv: "6299efa9da2ace966892e14ff61a0dd8"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.203810 28729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:50.243873 28729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:50.248908 28729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:50.249235 28729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:50.252269 28729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:50.252403 28729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:50.252568 28729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:50.252655 28729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:17:50 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:50.282578 28769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.252850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:46257 (local address 127.15.164.254:44015)
0812 11:17:50.253680 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:50.253689 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:50.254932 (+ 1243us) server_negotiation.cc:407] Connection header received
0812 11:17:50.257470 (+ 2538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:50.257477 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:50.257590 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:50.257730 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:50.260794 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.261951 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.264736 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.265501 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.265673 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.272815 (+ 7142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:50.272829 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:50.272835 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:50.272899 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:50.277445 (+ 4546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.278948 (+ 1503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.278959 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.278966 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.279180 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.279723 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.279731 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.279737 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.280213 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:50.280434 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:50.281629 (+ 1195us) server_negotiation.cc:299] Negotiation successful
0812 11:17:50.281966 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":563,"threads_started":1}
I20260812 11:17:50.283424 28770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.253701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.193:46257)
0812 11:17:50.254742 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:50.254793 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:50.257131 (+ 2338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:50.258046 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:50.258062 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:50.259509 (+ 1447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:50.260481 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.260517 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.262201 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.262205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.264502 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.264528 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.266103 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.266110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.266587 (+ 477us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.267701 (+ 1114us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:50.267750 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:50.272285 (+ 4535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:50.277698 (+ 5413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.277711 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.277741 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.278731 (+ 990us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.279332 (+ 601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.279335 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.279338 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.279580 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.280403 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:50.280410 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:50.280962 (+ 552us) client_negotiation.cc:769] Sending connection context
0812 11:17:50.281431 (+ 469us) client_negotiation.cc:240] Negotiation successful
0812 11:17:50.281881 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":455,"threads_started":1}
I20260812 11:17:50.306565 28769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.289985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:38251 (local address 127.15.164.254:44015)
0812 11:17:50.290354 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:50.290362 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:50.291031 (+ 669us) server_negotiation.cc:407] Connection header received
0812 11:17:50.291245 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:50.291255 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:50.291356 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:50.291473 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:50.292869 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.293770 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.295840 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.296605 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.296770 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.300181 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:50.300191 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:50.300195 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:50.300244 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:50.302999 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.304132 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.304141 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.304147 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.304332 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.304848 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.304854 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.304858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.305295 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:50.305474 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:50.305919 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 11:17:50.306171 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198}
I20260812 11:17:50.306923 28888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.290024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.193:38251)
0812 11:17:50.290893 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:50.290917 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:50.291095 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:50.291532 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:50.291544 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:50.292177 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:50.292711 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.292723 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.293986 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.293994 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.295676 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.295696 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.297087 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.297100 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.297440 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.298318 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:50.298346 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:50.299930 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:50.303161 (+ 3231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.303174 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.303181 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.303941 (+ 760us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.304500 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.304507 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.304510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.304692 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.305425 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:50.305431 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:50.305644 (+ 213us) client_negotiation.cc:769] Sending connection context
0812 11:17:50.305788 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 11:17:50.306236 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":472,"threads_started":1}
I20260812 11:17:50.311257 28729 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:40195
I20260812 11:17:50.311358 28939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:40195 every 8 connection(s)
I20260812 11:17:50.312747 28729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:50.315415 28940 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44015
I20260812 11:17:50.315712 28940 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:50.316517 28940 heartbeater.cc:511] Master 127.15.164.254:44015 requested a full tablet report, sending...
I20260812 11:17:50.318974 28617 ts_manager.cc:194] Registered new tserver with Master: 41908367f6f447769796945e4595fa35 (127.15.164.193:40195)
I20260812 11:17:50.320842 28617 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:46257
I20260812 11:17:50.321071 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 28729
I20260812 11:17:50.321300 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:50.322288 16019 external_mini_cluster.cc:1428] Setting key 2e62eddb283ede60f9f1c98143c1f77c
WARNING: no policy specified for oryx/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
I20260812 11:17:50.388443 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44015
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:50.771970 28945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:50.772326 28945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:50.772507 28945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:50.780503 28945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:50.780697 28945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:50.780845 28945 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:17:50.780990 28945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:50.791908 28945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:50.793381 28945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:50.794848 28945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:50.809506 28958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:50.809537 28962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:50.809754 28959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:50.810628 28945 server_base.cc:1034] running on GCE node
I20260812 11:17:50.811421 28945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:50.812623 28945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:50.813910 28945 hybrid_clock.cc:648] HybridClock initialized: now 1786533470813834 us; error 46 us; skew 500 ppm
I20260812 11:17:50.814296 28945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:50 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:50.818194 28945 init.cc:377] Logged in from keytab as oryx/127.15.164.194@KRBTEST.COM (short username oryx)
I20260812 11:17:50.819926 28945 webserver.cc:460] Webserver started at http://127.15.164.194:41101/ using document root <none> and password file <none>
I20260812 11:17:50.820729 28945 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:50.820875 28945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:50.821233 28945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:50.824697 28945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "093457812abc8edcc40fe2655703d8b0"
server_key_iv: "d83db294bb18a5a654b7ad92896925a9"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.825711 28945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "093457812abc8edcc40fe2655703d8b0"
server_key_iv: "d83db294bb18a5a654b7ad92896925a9"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.831817 28945 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 11:17:50.835992 28975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:50.837975 28945 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260812 11:17:50.838264 28945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
format_stamp: "Formatted at 2026-08-12 11:17:50 on dist-test-slave-7kzw"
server_key: "093457812abc8edcc40fe2655703d8b0"
server_key_iv: "d83db294bb18a5a654b7ad92896925a9"
server_key_version: "encryptionkey@0"
I20260812 11:17:50.838641 28945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:50.881073 28945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:50.886713 28945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:50.887079 28945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:50.890317 28945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:50.890453 28945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:50.890676 28945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:50.890779 28945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:17:50 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:50.919786 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.891325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:34563 (local address 127.15.164.254:44015)
0812 11:17:50.891916 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:50.891924 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:50.893337 (+ 1413us) server_negotiation.cc:407] Connection header received
0812 11:17:50.897053 (+ 3716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:50.897065 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:50.897177 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:50.897334 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:50.900048 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.901235 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.903852 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.904297 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.904447 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.908877 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:50.908886 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:50.908891 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:50.908941 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:50.913692 (+ 4751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.915282 (+ 1590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.915291 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.915296 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.915481 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.916397 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.916404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.916407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.916917 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:50.917116 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:50.918707 (+ 1591us) server_negotiation.cc:299] Negotiation successful
0812 11:17:50.919120 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":281,"threads_started":1}
I20260812 11:17:50.920267 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.892073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.194:34563)
0812 11:17:50.893106 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:50.893182 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:50.896533 (+ 3351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:50.897771 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:50.897792 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:50.898714 (+ 922us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:50.899805 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.899845 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.901417 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.901424 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.903668 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.903686 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.904590 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.904599 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.904828 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.905585 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:50.905617 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:50.908561 (+ 2944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:50.913942 (+ 5381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.913966 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.913997 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.915036 (+ 1039us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.915627 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.915689 (+ 62us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.915698 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.916149 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.917082 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:50.917090 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:50.917879 (+ 789us) client_negotiation.cc:769] Sending connection context
0812 11:17:50.918425 (+ 546us) client_negotiation.cc:240] Negotiation successful
0812 11:17:50.918960 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":380,"threads_started":1}
I20260812 11:17:50.951522 28945 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:38207
I20260812 11:17:50.951586 29169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:38207 every 8 connection(s)
I20260812 11:17:50.953075 28945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:50.953467 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.928391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.194:38593)
0812 11:17:50.933352 (+ 4961us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:50.933377 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:50.933596 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:50.934149 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:50.934159 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:50.935204 (+ 1045us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:50.936060 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.936085 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.938007 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.938038 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.940731 (+ 2693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:50.940752 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.941780 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.941792 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:50.942037 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.943031 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:50.943062 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:50.944840 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:50.949898 (+ 5058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.949907 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.949914 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.950648 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.951287 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:50.951296 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:50.951302 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:50.951529 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:50.952371 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:50.952375 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:50.952544 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 11:17:50.952685 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:17:50.952950 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4759,"thread_start_us":4550,"threads_started":1}
I20260812 11:17:50.953480 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:50.928957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:38593 (local address 127.15.164.254:44015)
0812 11:17:50.929246 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:50.929256 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:50.933515 (+ 4259us) server_negotiation.cc:407] Connection header received
0812 11:17:50.933770 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:50.933780 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:50.933917 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:50.934043 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:50.936298 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.937794 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.940922 (+ 3128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:50.941475 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:50.941721 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:50.945187 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:50.945200 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:50.945209 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:50.945283 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:50.949680 (+ 4397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.950898 (+ 1218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.950909 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.950913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.951100 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:50.951783 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:50.951789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:50.951792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:50.952175 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:50.952293 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:50.952864 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 11:17:50.953144 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:17:50.956668 29174 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44015
I20260812 11:17:50.956979 29174 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:50.957774 29174 heartbeater.cc:511] Master 127.15.164.254:44015 requested a full tablet report, sending...
I20260812 11:17:50.959335 28617 ts_manager.cc:194] Registered new tserver with Master: 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207)
I20260812 11:17:50.959679 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 28945
I20260812 11:17:50.959872 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:50.960433 16019 external_mini_cluster.cc:1428] Setting key 231e7dab0096a4f6ee25c84f7d29f29a
I20260812 11:17:50.960565 28617 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:34563
WARNING: no policy specified for oryx/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
I20260812 11:17:51.023135 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44015
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:17:51.325093 28940 heartbeater.cc:503] Master 127.15.164.254:44015 was elected leader, sending a full tablet report...
W20260812 11:17:51.407727 29179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:51.408116 29179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:51.408285 29179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:51.416712 29179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:51.416865 29179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:51.417027 29179 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:17:51.417173 29179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:17:51.428467 29179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.164.254:44015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:51.429917 29179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:51.431404 29179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:51.445369 29196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:51.445436 29186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:51.445432 29188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:51.446506 29179 server_base.cc:1034] running on GCE node
I20260812 11:17:51.447253 29179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:51.448318 29179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:51.449582 29179 hybrid_clock.cc:648] HybridClock initialized: now 1786533471449520 us; error 58 us; skew 500 ppm
I20260812 11:17:51.449960 29179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533471, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:51.453449 29179 init.cc:377] Logged in from keytab as oryx/127.15.164.195@KRBTEST.COM (short username oryx)
I20260812 11:17:51.455256 29179 webserver.cc:460] Webserver started at http://127.15.164.195:44263/ using document root <none> and password file <none>
I20260812 11:17:51.456102 29179 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:51.456245 29179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:51.456599 29179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:51.459669 29179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "f99269d03c0e4cd0b3a16d654e348939"
format_stamp: "Formatted at 2026-08-12 11:17:51 on dist-test-slave-7kzw"
server_key: "3a4ff3836d0a2dbae5285c4a4fd7e06b"
server_key_iv: "1ede126796bb3e0ee4db81a34d653177"
server_key_version: "encryptionkey@0"
I20260812 11:17:51.460508 29179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "f99269d03c0e4cd0b3a16d654e348939"
format_stamp: "Formatted at 2026-08-12 11:17:51 on dist-test-slave-7kzw"
server_key: "3a4ff3836d0a2dbae5285c4a4fd7e06b"
server_key_iv: "1ede126796bb3e0ee4db81a34d653177"
server_key_version: "encryptionkey@0"
I20260812 11:17:51.465963 29179 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 11:17:51.469739 29207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:51.471262 29179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:51.471460 29179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "f99269d03c0e4cd0b3a16d654e348939"
format_stamp: "Formatted at 2026-08-12 11:17:51 on dist-test-slave-7kzw"
server_key: "3a4ff3836d0a2dbae5285c4a4fd7e06b"
server_key_iv: "1ede126796bb3e0ee4db81a34d653177"
server_key_version: "encryptionkey@0"
I20260812 11:17:51.471709 29179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:51.485502 29179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:51.490298 29179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:51.490698 29179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:51.493780 29179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:51.493899 29179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:51.494047 29179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:51.494134 29179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533471, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:51.523387 29225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.494354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:60017 (local address 127.15.164.254:44015)
0812 11:17:51.495161 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.495165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.496215 (+ 1050us) server_negotiation.cc:407] Connection header received
0812 11:17:51.499263 (+ 3048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.499270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.499371 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.499498 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:51.502323 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.503733 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.507325 (+ 3592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.507947 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.508100 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.513750 (+ 5650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:51.513761 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:51.513769 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:51.513820 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:51.517919 (+ 4099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.519100 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.519105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.519107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.519249 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.519919 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.519925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.519928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.520350 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:51.520515 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.522720 (+ 2205us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.522974 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":549,"threads_started":1}
I20260812 11:17:51.523865 29226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.495071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.195:60017)
0812 11:17:51.496002 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.496050 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.498887 (+ 2837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.499779 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.499788 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.501092 (+ 1304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:51.502029 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.502070 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.503992 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.504001 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.507018 (+ 3017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.507041 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.508378 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.508387 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.508689 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.509735 (+ 1046us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:51.509777 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:51.513445 (+ 3668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:51.518106 (+ 4661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:51.518121 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:51.518152 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:51.518910 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:51.519437 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:51.519445 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:51.519452 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:51.519779 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:51.520488 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:51.520496 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:51.521121 (+ 625us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.521477 (+ 356us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.522130 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":389,"threads_started":1}
I20260812 11:17:51.550724 29179 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:36773
I20260812 11:17:51.550786 29408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:36773 every 8 connection(s)
I20260812 11:17:51.552419 29179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:17:51.554018 29369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.537507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.15.164.195:56473)
0812 11:17:51.538380 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.538396 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.538622 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.539094 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.539104 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.539584 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:51.539903 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.539913 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.541731 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.541755 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.543030 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.543043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.544369 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.544376 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.544546 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.545491 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:51.545518 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:51.546303 (+ 785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:51.550906 (+ 4603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:51.550911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:51.550915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:51.551359 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:51.551796 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:51.551799 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:51.551801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:51.551928 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:51.552684 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:51.552687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:51.552901 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.553121 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.553498 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":530,"threads_started":1}
I20260812 11:17:51.554088 29225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.537387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:56473 (local address 127.15.164.254:44015)
0812 11:17:51.537583 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.537588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.538532 (+ 944us) server_negotiation.cc:407] Connection header received
0812 11:17:51.538789 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.538799 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.538915 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.539032 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:51.540067 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.541526 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.543187 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.544015 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.544336 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.546591 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:51.546599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:51.546604 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:51.546646 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:51.550744 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.551496 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.551502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.551506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.551674 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.552051 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.552056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.552059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.552479 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:51.552690 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.553256 (+ 566us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.553581 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:17:51.554924 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 29179
I20260812 11:17:51.555150 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:17:51.555629 16019 external_mini_cluster.cc:1428] Setting key 1065d9a947200790cf02766065fdca41
I20260812 11:17:51.558295 29409 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44015
I20260812 11:17:51.558583 29409 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:51.559474 29409 heartbeater.cc:511] Master 127.15.164.254:44015 requested a full tablet report, sending...
I20260812 11:17:51.560995 28617 ts_manager.cc:194] Registered new tserver with Master: f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773)
I20260812 11:17:51.561771 28617 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:60017
I20260812 11:17:51.571820 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533471, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:17:51.643777 29225 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:51.628499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39938 (local address 127.15.164.254:44015)
0812 11:17:51.628764 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.628772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.628923 (+ 151us) server_negotiation.cc:407] Connection header received
0812 11:17:51.629192 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.629199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.629267 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.629385 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:51.630883 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.631691 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.633062 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.633484 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.633626 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.643507 (+ 9881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39938: BlockingRecv error: recv got EOF from 127.0.0.1:39938 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 12 11:17:51 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533471, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:51.663908 29225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.647695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39944 (local address 127.15.164.254:44015)
0812 11:17:51.647889 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.647894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.648320 (+ 426us) server_negotiation.cc:407] Connection header received
0812 11:17:51.648444 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.648448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.648516 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.648654 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:51.649926 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.650851 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.652164 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.652651 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.652760 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.657107 (+ 4347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:51.657113 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:51.657117 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:51.657155 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:51.660214 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.660960 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.660965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.660968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.661192 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:51.661787 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:51.661793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:51.661797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:51.662307 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:51.662811 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.663106 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.663485 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:17:51.675557 28617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:51.683933 28617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:51.718529 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.698740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.15.164.195:36773)
0812 11:17:51.708710 (+ 9970us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.708725 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.708771 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:17:51.708881 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.708889 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.709257 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.711395 (+ 2138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:51.711805 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.713411 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.715821 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.717204 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.717440 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.717650 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.717968 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.718158 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9729,"thread_start_us":9542,"threads_started":1}
I20260812 11:17:51.718597 29436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.697807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36773 (local address 127.0.0.1:45226)
0812 11:17:51.699100 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.699153 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.699424 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.709596 (+ 10172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.709608 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.709670 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:51.710187 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.710198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.713577 (+ 3379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.713584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.715577 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.715596 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.717436 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.717443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.717655 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.717722 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.717894 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.718117 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"mutex_wait_us":63,"thread_start_us":9619,"threads_started":1}
I20260812 11:17:51.719269 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.698095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38207 (local address 127.0.0.1:57760)
0812 11:17:51.707723 (+ 9628us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.707745 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.707931 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.710358 (+ 2427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.710364 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.710396 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:51.710893 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.710907 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.712894 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.712902 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.715842 (+ 2940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.715862 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.718349 (+ 2487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.718356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.718569 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.718608 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.718713 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.718853 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9493,"mutex_wait_us":154,"thread_start_us":916,"threads_started":1}
I20260812 11:17:51.719590 29445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.709161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40195 (local address 127.0.0.1:59578)
0812 11:17:51.710155 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.710183 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.710342 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.711030 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.711040 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.711076 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:51.711540 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.711554 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.713557 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.713562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.716290 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.716306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.718773 (+ 2467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.718780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.718930 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.718977 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.719066 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.719192 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":99,"thread_start_us":640,"threads_started":1}
I20260812 11:17:51.720106 29441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.698738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57760 (local address 127.15.164.194:38207)
0812 11:17:51.709686 (+ 10948us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.709697 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.709729 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:17:51.709843 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.709852 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.710125 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.711157 (+ 1032us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:51.711381 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.712599 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.716070 (+ 3471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.717781 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.717968 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.718174 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.719648 (+ 1474us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.719841 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10751,"thread_start_us":10639,"threads_started":1}
I20260812 11:17:51.720311 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.708256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.15.164.193:40195)
0812 11:17:51.709158 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.709172 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.710316 (+ 1144us) server_negotiation.cc:407] Connection header received
0812 11:17:51.710576 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.710584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.710820 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.711029 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:51.711805 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.713379 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.716500 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.718217 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.718401 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.718587 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.719904 (+ 1317us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.720084 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":496,"threads_started":1}
I20260812 11:17:51.723664 28839 tablet_service.cc:1467] Processing CreateTablet for tablet 1afd6907be6048b89c1e01302d342b7a (DEFAULT_TABLE table=test-table [id=0d3fee314e17442c8aefd3fc54427c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.723402 29298 tablet_service.cc:1467] Processing CreateTablet for tablet 1afd6907be6048b89c1e01302d342b7a (DEFAULT_TABLE table=test-table [id=0d3fee314e17442c8aefd3fc54427c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.723672 29053 tablet_service.cc:1467] Processing CreateTablet for tablet 1afd6907be6048b89c1e01302d342b7a (DEFAULT_TABLE table=test-table [id=0d3fee314e17442c8aefd3fc54427c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.724900 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1afd6907be6048b89c1e01302d342b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.724989 29053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1afd6907be6048b89c1e01302d342b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.724987 29298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1afd6907be6048b89c1e01302d342b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.738283 29447 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Bootstrap starting.
I20260812 11:17:51.740073 29450 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Bootstrap starting.
I20260812 11:17:51.743930 29447 tablet_bootstrap.cc:654] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.743932 29450 tablet_bootstrap.cc:654] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.745458 29450 log.cc:824] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:51.745452 29447 log.cc:824] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:51.746289 29451 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Bootstrap starting.
I20260812 11:17:51.749346 29447 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: No bootstrap required, opened a new log
I20260812 11:17:51.749680 29447 ts_tablet_manager.cc:1397] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260812 11:17:51.750751 29450 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: No bootstrap required, opened a new log
I20260812 11:17:51.751055 29450 ts_tablet_manager.cc:1397] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260812 11:17:51.751070 29451 tablet_bootstrap.cc:654] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.752477 29451 log.cc:824] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:51.755947 29451 tablet_bootstrap.cc:492] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: No bootstrap required, opened a new log
I20260812 11:17:51.756255 29451 ts_tablet_manager.cc:1397] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:17:51.759159 29450 raft_consensus.cc:348] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.759555 29450 raft_consensus.cc:374] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.759662 29450 raft_consensus.cc:729] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.760334 29450 consensus_queue.cc:260] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.761695 29174 heartbeater.cc:503] Master 127.15.164.254:44015 was elected leader, sending a full tablet report...
I20260812 11:17:51.761608 29447 raft_consensus.cc:348] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.762048 29447 raft_consensus.cc:374] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.762143 29447 raft_consensus.cc:729] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41908367f6f447769796945e4595fa35, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.762414 29450 ts_tablet_manager.cc:1428] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 11:17:51.762814 29447 consensus_queue.cc:260] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.770440 29451 raft_consensus.cc:348] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.771136 29451 raft_consensus.cc:374] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.771261 29451 raft_consensus.cc:729] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.771982 29451 consensus_queue.cc:260] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.772235 29447 ts_tablet_manager.cc:1428] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Time spent starting tablet: real 0.022s user 0.018s sys 0.004s
I20260812 11:17:51.773200 29409 heartbeater.cc:503] Master 127.15.164.254:44015 was elected leader, sending a full tablet report...
I20260812 11:17:51.774056 29451 ts_tablet_manager.cc:1428] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260812 11:17:51.775334 29458 raft_consensus.cc:482] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:51.775707 29458 raft_consensus.cc:504] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.777936 29458 leader_election.cc:288] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207), 41908367f6f447769796945e4595fa35 (127.15.164.193:40195)
I20260812 11:17:51.785228 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.779123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:35885 (local address 127.15.164.193:40195)
0812 11:17:51.779360 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.779368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.779612 (+ 244us) server_negotiation.cc:407] Connection header received
0812 11:17:51.779868 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.779874 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.779952 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.780047 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:51.780517 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.781324 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.783372 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.784132 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.784324 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.784402 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.784825 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.784954 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:17:51.785271 29441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.778891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:43893 (local address 127.15.164.194:38207)
0812 11:17:51.779323 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.779329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.779347 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:17:51.779408 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.779411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.779470 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.779590 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:51.780110 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.780938 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.783225 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.784066 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.784270 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.784358 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.784818 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.784967 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306}
I20260812 11:17:51.785389 29226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.778333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38207 (local address 127.15.164.195:43893)
0812 11:17:51.778599 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.778625 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.778815 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.779613 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.779618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.779678 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:51.779940 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.779953 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.781083 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.781090 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.783036 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.783049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.784248 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.784255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.784514 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.784659 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.784787 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.784967 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":91,"spinlock_wait_cycles":2944}
I20260812 11:17:51.785432 29459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.778487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40195 (local address 127.15.164.195:35885)
0812 11:17:51.779515 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:51.779529 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:51.779733 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:51.780062 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:51.780066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:51.780090 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:51.780374 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.780382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.781456 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.781461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.783213 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:51.783225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.784363 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.784370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:51.784597 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.784686 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 11:17:51.784797 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:17:51.784954 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":43,"spinlock_wait_cycles":896,"thread_start_us":1204,"threads_started":1}
I20260812 11:17:51.786860 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1afd6907be6048b89c1e01302d342b7a" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35" is_pre_election: true
I20260812 11:17:51.786860 29094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1afd6907be6048b89c1e01302d342b7a" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" is_pre_election: true
I20260812 11:17:51.787467 29094 raft_consensus.cc:2454] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:51.787467 28871 raft_consensus.cc:2454] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:51.788190 29217 leader_election.cc:302] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75233e3c76214d0fb6f4d95c6a8c0d77, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:51.788561 29458 raft_consensus.cc:2781] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:51.788762 29458 raft_consensus.cc:482] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:51.788894 29458 raft_consensus.cc:3037] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:51.791452 29458 raft_consensus.cc:504] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.792261 29458 leader_election.cc:288] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Requested vote from peers 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207), 41908367f6f447769796945e4595fa35 (127.15.164.193:40195)
I20260812 11:17:51.792742 29094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1afd6907be6048b89c1e01302d342b7a" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
I20260812 11:17:51.792831 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1afd6907be6048b89c1e01302d342b7a" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35"
I20260812 11:17:51.792979 29094 raft_consensus.cc:3037] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:51.793138 28871 raft_consensus.cc:3037] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:51.795670 29094 raft_consensus.cc:2454] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:51.795722 28871 raft_consensus.cc:2454] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:51.796173 29217 leader_election.cc:302] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75233e3c76214d0fb6f4d95c6a8c0d77, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:51.796526 29458 raft_consensus.cc:2781] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:51.797025 29458 raft_consensus.cc:686] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Becoming Leader. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Running, Role: LEADER
I20260812 11:17:51.797659 29458 consensus_queue.cc:237] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } }
I20260812 11:17:51.803113 28616 catalog_manager.cc:5495] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 reported cstate change: term changed from 0 to 1, leader changed from <none> to f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195). New cstate: current_term: 1 leader_uuid: "f99269d03c0e4cd0b3a16d654e348939" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } health_report { overall_health: UNKNOWN } } }
W20260812 11:17:51.807679 29410 tablet.cc:2369] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:17:51.815619 28941 tablet.cc:2369] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:51.840627 29442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:51.834366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.15.164.195:36773)
0812 11:17:51.834647 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:51.834652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:51.834671 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:17:51.834937 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:51.834942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:51.835045 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:51.835205 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:51.835629 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.836388 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.837885 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:51.838503 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:51.838651 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:51.839210 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:51.839841 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:51.839961 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:51.840148 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 11:17:51.840226 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260812 11:17:51.849964 29094 raft_consensus.cc:1261] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Refusing update from remote peer f99269d03c0e4cd0b3a16d654e348939: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:51.849970 28871 raft_consensus.cc:1261] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Refusing update from remote peer f99269d03c0e4cd0b3a16d654e348939: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:51.850986 29460 consensus_queue.cc:1035] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:51.851394 29458 consensus_queue.cc:1035] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:51.881233 28616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:51.881604 28616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:51.885669 28616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Sending DeleteTablet for 3 replicas of tablet 1afd6907be6048b89c1e01302d342b7a
I20260812 11:17:51.886996 29298 tablet_service.cc:1514] Processing DeleteTablet for tablet 1afd6907be6048b89c1e01302d342b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:51 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 11:17:51.887199 29053 tablet_service.cc:1514] Processing DeleteTablet for tablet 1afd6907be6048b89c1e01302d342b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:51 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57760
I20260812 11:17:51.888731 28839 tablet_service.cc:1514] Processing DeleteTablet for tablet 1afd6907be6048b89c1e01302d342b7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:51 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59578
I20260812 11:17:51.889770 29481 tablet_replica.cc:330] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: stopping tablet replica
I20260812 11:17:51.889808 28617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:17:51.890559 29481 raft_consensus.cc:2229] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 11:17:51.890663 28617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:51.891274 29481 raft_consensus.cc:2258] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:51.893811 29481 ts_tablet_manager.cc:1905] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:51.896854 29480 tablet_replica.cc:330] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: stopping tablet replica
I20260812 11:17:51.897325 29480 raft_consensus.cc:2229] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:51.897838 29480 raft_consensus.cc:2258] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:51.899482 29052 tablet_service.cc:1467] Processing CreateTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f (DEFAULT_TABLE table=test-table [id=bb90ed63d5a5441f979d07488e846081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.900194 29052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b4c1fa1a74ce5832df66f94afeb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.902041 29480 ts_tablet_manager.cc:1905] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:51.902385 29481 ts_tablet_manager.cc:1918] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:51.902689 29481 log.cc:1196] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/1afd6907be6048b89c1e01302d342b7a
I20260812 11:17:51.903393 29481 ts_tablet_manager.cc:1939] T 1afd6907be6048b89c1e01302d342b7a P 41908367f6f447769796945e4595fa35: Deleting consensus metadata
I20260812 11:17:51.903744 28839 tablet_service.cc:1467] Processing CreateTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f (DEFAULT_TABLE table=test-table [id=bb90ed63d5a5441f979d07488e846081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.904263 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b4c1fa1a74ce5832df66f94afeb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.906831 28592 catalog_manager.cc:4841] TS 41908367f6f447769796945e4595fa35 (127.15.164.193:40195): tablet 1afd6907be6048b89c1e01302d342b7a (table test-table [id=0d3fee314e17442c8aefd3fc54427c54]) successfully deleted
I20260812 11:17:51.908257 29297 tablet_service.cc:1467] Processing CreateTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f (DEFAULT_TABLE table=test-table [id=bb90ed63d5a5441f979d07488e846081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:51.909075 29297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 969b4c1fa1a74ce5832df66f94afeb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:51.909487 29480 ts_tablet_manager.cc:1918] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:51.909682 29480 log.cc:1196] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/1afd6907be6048b89c1e01302d342b7a
I20260812 11:17:51.910288 29480 ts_tablet_manager.cc:1939] T 1afd6907be6048b89c1e01302d342b7a P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting consensus metadata
I20260812 11:17:51.917007 29451 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Bootstrap starting.
I20260812 11:17:51.919088 29451 tablet_bootstrap.cc:654] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.922429 28591 catalog_manager.cc:4841] TS 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207): tablet 1afd6907be6048b89c1e01302d342b7a (table test-table [id=0d3fee314e17442c8aefd3fc54427c54]) successfully deleted
I20260812 11:17:51.924341 29447 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Bootstrap starting.
I20260812 11:17:51.924819 29450 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Bootstrap starting.
I20260812 11:17:51.926774 29447 tablet_bootstrap.cc:654] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.927860 29450 tablet_bootstrap.cc:654] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:51.929316 29451 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: No bootstrap required, opened a new log
I20260812 11:17:51.929553 29451 ts_tablet_manager.cc:1397] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.008s
I20260812 11:17:51.930905 29451 raft_consensus.cc:348] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.931385 29451 raft_consensus.cc:374] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.931624 29451 raft_consensus.cc:729] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.932056 29451 consensus_queue.cc:260] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.934170 29451 ts_tablet_manager.cc:1428] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:17:51.936846 29450 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: No bootstrap required, opened a new log
I20260812 11:17:51.937075 29450 ts_tablet_manager.cc:1397] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260812 11:17:51.937981 29450 raft_consensus.cc:348] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.938212 29450 raft_consensus.cc:374] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.938319 29450 raft_consensus.cc:729] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.940158 29450 consensus_queue.cc:260] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.940840 29450 ts_tablet_manager.cc:1428] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260812 11:17:51.941682 29479 tablet_replica.cc:330] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: stopping tablet replica
I20260812 11:17:51.942239 29479 raft_consensus.cc:2229] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:51.943037 29479 raft_consensus.cc:2258] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:51.946801 29479 ts_tablet_manager.cc:1905] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:51.949008 29447 tablet_bootstrap.cc:492] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: No bootstrap required, opened a new log
I20260812 11:17:51.949215 29447 ts_tablet_manager.cc:1397] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.004s
I20260812 11:17:51.950145 29447 raft_consensus.cc:348] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.950435 29447 raft_consensus.cc:374] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:51.950690 29447 raft_consensus.cc:729] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41908367f6f447769796945e4595fa35, State: Initialized, Role: FOLLOWER
I20260812 11:17:51.951225 29447 consensus_queue.cc:260] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:51.953114 29447 ts_tablet_manager.cc:1428] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 11:17:51.956887 29479 ts_tablet_manager.cc:1918] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260812 11:17:51.956907 29175 tablet.cc:2369] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:17:51.957185 29479 log.cc:1196] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/1afd6907be6048b89c1e01302d342b7a
I20260812 11:17:51.957844 29479 ts_tablet_manager.cc:1939] T 1afd6907be6048b89c1e01302d342b7a P f99269d03c0e4cd0b3a16d654e348939: Deleting consensus metadata
I20260812 11:17:51.959923 28592 catalog_manager.cc:4841] TS f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773): tablet 1afd6907be6048b89c1e01302d342b7a (table test-table [id=0d3fee314e17442c8aefd3fc54427c54]) successfully deleted
I20260812 11:17:52.152937 29472 raft_consensus.cc:482] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:52.153205 29472 raft_consensus.cc:504] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.154184 29472 leader_election.cc:288] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207)
I20260812 11:17:52.154860 29094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "969b4c1fa1a74ce5832df66f94afeb7f" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" is_pre_election: true
I20260812 11:17:52.154874 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "969b4c1fa1a74ce5832df66f94afeb7f" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35" is_pre_election: true
I20260812 11:17:52.155138 29094 raft_consensus.cc:2454] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:52.155161 28871 raft_consensus.cc:2454] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:52.155666 29219 leader_election.cc:302] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41908367f6f447769796945e4595fa35, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:52.156028 29472 raft_consensus.cc:2781] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:52.156180 29472 raft_consensus.cc:482] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:52.156306 29472 raft_consensus.cc:3037] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.159614 29472 raft_consensus.cc:504] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.160310 29472 leader_election.cc:288] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Requested vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207)
I20260812 11:17:52.160899 29094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "969b4c1fa1a74ce5832df66f94afeb7f" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
I20260812 11:17:52.161131 29094 raft_consensus.cc:3037] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.162714 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "969b4c1fa1a74ce5832df66f94afeb7f" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35"
I20260812 11:17:52.162935 28871 raft_consensus.cc:3037] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.164211 29094 raft_consensus.cc:2454] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:52.164713 29217 leader_election.cc:302] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75233e3c76214d0fb6f4d95c6a8c0d77, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:52.165019 29472 raft_consensus.cc:2781] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:52.165182 29472 raft_consensus.cc:686] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Becoming Leader. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Running, Role: LEADER
I20260812 11:17:52.165416 28871 raft_consensus.cc:2454] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:52.165531 29472 consensus_queue.cc:237] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.168476 28616 catalog_manager.cc:5495] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 reported cstate change: term changed from 0 to 1, leader changed from <none> to f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195). New cstate: current_term: 1 leader_uuid: "f99269d03c0e4cd0b3a16d654e348939" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } health_report { overall_health: HEALTHY } } }
Aug 12 11:17:52 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.254@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:52.258842 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.241181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44015 (local address 127.0.0.1:39946)
0812 11:17:52.242564 (+ 1383us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.242592 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.242741 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.243152 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.243155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.243930 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:52.244240 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.244251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.245987 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.245991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.247090 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.247103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.248112 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.248117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.248326 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.249104 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:52.249124 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:52.251782 (+ 2658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:52.255979 (+ 4197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:52.255992 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:52.255999 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:52.256477 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:52.256941 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:52.256945 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:52.256947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:52.257114 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:52.257824 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:52.257831 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:52.257988 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.258138 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.258373 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"thread_start_us":1059,"threads_started":1}
I20260812 11:17:52.259083 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.241234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39946 (local address 127.15.164.254:44015)
0812 11:17:52.242031 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.242042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.242699 (+ 657us) server_negotiation.cc:407] Connection header received
0812 11:17:52.242875 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.242881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.242975 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.243115 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:52.244457 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.245743 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.247287 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.247933 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.248077 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.252010 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:52.252018 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:52.252025 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:52.252068 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:52.255833 (+ 3765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:52.256629 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:52.256638 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:52.256641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:52.256810 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:52.257261 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:52.257266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:52.257270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:52.257679 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:52.257842 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.258312 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.258587 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":347,"threads_started":1}
I20260812 11:17:52.265363 28616 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:39946:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:17:52.266846 28616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:52.275317 28839 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5e286e719e438385a73ed3f5598f73 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d67cc4cc0f2749b68182be6b336a2542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:17:52.275749 29052 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5e286e719e438385a73ed3f5598f73 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d67cc4cc0f2749b68182be6b336a2542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:17:52.276002 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5e286e719e438385a73ed3f5598f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.276343 29052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5e286e719e438385a73ed3f5598f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.283115 29298 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5e286e719e438385a73ed3f5598f73 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d67cc4cc0f2749b68182be6b336a2542]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:17:52.283843 29298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5e286e719e438385a73ed3f5598f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.284408 29447 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: Bootstrap starting.
I20260812 11:17:52.286810 29447 tablet_bootstrap.cc:654] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.286895 29450 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: Bootstrap starting.
I20260812 11:17:52.288796 29450 tablet_bootstrap.cc:654] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.294229 29451 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: Bootstrap starting.
I20260812 11:17:52.296967 29451 tablet_bootstrap.cc:654] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.299292 29450 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: No bootstrap required, opened a new log
I20260812 11:17:52.299552 29450 ts_tablet_manager.cc:1397] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260812 11:17:52.299576 29447 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: No bootstrap required, opened a new log
I20260812 11:17:52.299815 29447 ts_tablet_manager.cc:1397] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.005s
I20260812 11:17:52.300514 29450 raft_consensus.cc:348] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.300889 29450 raft_consensus.cc:374] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.300765 29447 raft_consensus.cc:348] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.301036 29450 raft_consensus.cc:729] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.301137 29447 raft_consensus.cc:374] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.301265 29447 raft_consensus.cc:729] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41908367f6f447769796945e4595fa35, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.301623 29450 consensus_queue.cc:260] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.301612 29447 consensus_queue.cc:260] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.302444 29447 ts_tablet_manager.cc:1428] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 11:17:52.302254 29457 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.302675 29457 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.306354 29456 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.307334 29456 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.309526 29450 ts_tablet_manager.cc:1428] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20260812 11:17:52.312088 29451 tablet_bootstrap.cc:492] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: No bootstrap required, opened a new log
I20260812 11:17:52.312286 29451 ts_tablet_manager.cc:1397] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.004s
I20260812 11:17:52.313097 29451 raft_consensus.cc:348] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.313369 29451 raft_consensus.cc:374] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.313445 29451 raft_consensus.cc:729] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.313683 29451 consensus_queue.cc:260] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.314272 29451 ts_tablet_manager.cc:1428] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 11:17:52.314188 29472 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.314590 29472 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.428658 29456 raft_consensus.cc:482] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:52.428879 29456 raft_consensus.cc:504] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.430498 29456 leader_election.cc:288] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773)
I20260812 11:17:52.437654 29502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.431074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40195 (local address 127.15.164.194:55393)
0812 11:17:52.431716 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.431743 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.431917 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.432451 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.432461 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.432502 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:52.432873 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.432884 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.434145 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.434151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.435602 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.435618 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.436801 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.436808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.436971 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.436996 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.437134 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.437274 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":371,"threads_started":1}
I20260812 11:17:52.437678 29503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.431184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:55393 (local address 127.15.164.193:40195)
0812 11:17:52.431716 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.431721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.431896 (+ 175us) server_negotiation.cc:407] Connection header received
0812 11:17:52.432112 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.432118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.432208 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.433068 (+ 860us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:52.433270 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.433995 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.435761 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.436634 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.436820 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.436898 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.437172 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.437335 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":292,"threads_started":1}
I20260812 11:17:52.438619 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5e286e719e438385a73ed3f5598f73" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35" is_pre_election: true
I20260812 11:17:52.438954 28871 raft_consensus.cc:2454] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 0.
I20260812 11:17:52.439352 29504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.431944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36773 (local address 127.15.164.194:38681)
0812 11:17:52.432656 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.432680 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.432817 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.433233 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.433239 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.433268 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:17:52.433649 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.433659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.434950 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.434960 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.436645 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.436728 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.438458 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.438484 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.438688 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.438715 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.438826 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.438963 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":324,"threads_started":1}
I20260812 11:17:52.439358 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.432067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:38681 (local address 127.15.164.195:36773)
0812 11:17:52.432848 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.432858 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.432884 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:17:52.432972 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.432978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.433091 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.433212 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:17:52.433830 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.434780 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.436927 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.438205 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.438415 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.438521 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.438869 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.439018 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":519,"threads_started":1}
I20260812 11:17:52.439514 28983 leader_election.cc:302] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41908367f6f447769796945e4595fa35, 75233e3c76214d0fb6f4d95c6a8c0d77; no voters:
I20260812 11:17:52.439924 29456 raft_consensus.cc:2781] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:52.440071 29456 raft_consensus.cc:482] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:52.440227 29456 raft_consensus.cc:3037] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.440729 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5e286e719e438385a73ed3f5598f73" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f99269d03c0e4cd0b3a16d654e348939" is_pre_election: true
I20260812 11:17:52.441191 29329 raft_consensus.cc:2454] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 0.
I20260812 11:17:52.443231 29456 raft_consensus.cc:504] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.443755 29456 leader_election.cc:288] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 election: Requested vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773)
I20260812 11:17:52.444346 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5e286e719e438385a73ed3f5598f73" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f99269d03c0e4cd0b3a16d654e348939"
I20260812 11:17:52.444353 28871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5e286e719e438385a73ed3f5598f73" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35"
I20260812 11:17:52.444574 28871 raft_consensus.cc:3037] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.444623 29329 raft_consensus.cc:3037] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.446895 29329 raft_consensus.cc:2454] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 1.
I20260812 11:17:52.447077 28871 raft_consensus.cc:2454] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 1.
I20260812 11:17:52.447348 28983 leader_election.cc:302] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75233e3c76214d0fb6f4d95c6a8c0d77, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:52.447681 29456 raft_consensus.cc:2781] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:52.448238 29456 raft_consensus.cc:686] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 LEADER]: Becoming Leader. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Running, Role: LEADER
I20260812 11:17:52.449016 29456 consensus_queue.cc:237] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.451196 29509 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: TxnStatusTablet state changed. Reason: New leader 75233e3c76214d0fb6f4d95c6a8c0d77. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.451637 29509 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:17:52.452324 29511 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:17:52.452633 29511 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:17:52.453322 28617 catalog_manager.cc:5495] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } health_report { overall_health: UNKNOWN } } }
I20260812 11:17:52.495654 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.488750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38207 (local address 127.0.0.1:57764)
0812 11:17:52.489016 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.489042 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.489231 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.489926 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.489931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.489945 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:17:52.490204 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.490226 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.491582 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.491589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.492696 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.492709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.493594 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.493601 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.493809 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.493870 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.494993 (+ 1123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.495019 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.495123 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.495297 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:17:52.495734 29514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.488754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.15.164.194:38207)
0812 11:17:52.489512 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.489516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.489538 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:17:52.489624 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.489628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.489719 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.489903 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:52.490399 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.491428 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.492872 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.493421 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.493576 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.494142 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.494842 (+ 700us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.495038 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.495176 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.495266 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":384,"threads_started":1}
I20260812 11:17:52.500696 28871 raft_consensus.cc:1261] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Refusing update from remote peer 75233e3c76214d0fb6f4d95c6a8c0d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:52.501134 29329 raft_consensus.cc:1261] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Refusing update from remote peer 75233e3c76214d0fb6f4d95c6a8c0d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:52.501616 29509 consensus_queue.cc:1035] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:52.502012 29456 consensus_queue.cc:1035] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:52.507988 29457 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: TxnStatusTablet state changed. Reason: New leader 75233e3c76214d0fb6f4d95c6a8c0d77. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.508344 29457 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.514110 29515 mvcc.cc:205] Tried to move back new op lower bound from 7317641103354822656 to 7317641103155077120. Current Snapshot: MvccSnapshot[applied={T|T < 7317641103354822656}]
I20260812 11:17:52.522250 29457 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.523483 29457 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 41908367f6f447769796945e4595fa35: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.525313 29509 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.525614 29509 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:17:52.527981 29472 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: TxnStatusTablet state changed. Reason: New leader 75233e3c76214d0fb6f4d95c6a8c0d77. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.528355 29472 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.529775 29509 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.530062 29509 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P 75233e3c76214d0fb6f4d95c6a8c0d77: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:17:52.534047 29472 tablet_replica.cc:439] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } } }
I20260812 11:17:52.534361 29472 tablet_replica.cc:442] T 3f5e286e719e438385a73ed3f5598f73 P f99269d03c0e4cd0b3a16d654e348939: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:17:52.543644 29472 consensus_queue.cc:1035] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:52.556183 29514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.548326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:47539 (local address 127.15.164.194:38207)
0812 11:17:52.548516 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.548525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.549196 (+ 671us) server_negotiation.cc:407] Connection header received
0812 11:17:52.549415 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.549420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.549503 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.549597 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:52.550313 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.551516 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.553812 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.554617 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.554715 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.555402 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.555544 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.555605 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.555821 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.555903 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:17:52.556998 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.548338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38207 (local address 127.15.164.195:47539)
0812 11:17:52.549075 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.549091 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.549262 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.549632 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.549636 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.549651 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:17:52.550095 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.550115 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.551830 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.551837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.553636 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.553651 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.554931 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.554936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.555125 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.555192 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.555682 (+ 490us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.555692 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.556449 (+ 757us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.556590 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":368,"threads_started":1}
I20260812 11:17:52.569257 29460 consensus_queue.cc:1035] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:52.629137 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.622144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:60539 (local address 127.15.164.195:36773)
0812 11:17:52.622349 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.622357 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.623188 (+ 831us) server_negotiation.cc:407] Connection header received
0812 11:17:52.623365 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.623369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.623438 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.623568 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:52.624193 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.625124 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.627292 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.627729 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.627902 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.628378 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.628483 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.628586 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.628749 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.628837 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:17:52.629521 29539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.622168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:36773 (local address 127.15.164.194:60539)
0812 11:17:52.623067 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:52.623087 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:52.623237 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:52.623583 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:52.623589 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:52.623603 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:17:52.624031 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.624043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.625280 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.625286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.627128 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:52.627143 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.627945 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.627954 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:52.628098 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.628159 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.628590 (+ 431us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.628605 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 11:17:52.628717 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:17:52.628860 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":523,"threads_started":1}
I20260812 11:17:52.662597 28616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:52.662878 28616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:52.665907 28616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Sending DeleteTablet for 3 replicas of tablet 969b4c1fa1a74ce5832df66f94afeb7f
I20260812 11:17:52.666810 29298 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:52 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 11:17:52.666836 28839 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:52 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59578
I20260812 11:17:52.666929 29052 tablet_service.cc:1514] Processing DeleteTablet for tablet 969b4c1fa1a74ce5832df66f94afeb7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:52 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57760
I20260812 11:17:52.679239 29545 tablet_replica.cc:330] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: stopping tablet replica
I20260812 11:17:52.679575 29545 raft_consensus.cc:2229] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:52.679677 29544 tablet_replica.cc:330] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: stopping tablet replica
I20260812 11:17:52.679922 29545 raft_consensus.cc:2258] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:52.679888 29544 raft_consensus.cc:2229] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:52.680176 29544 raft_consensus.cc:2258] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:52.681712 29545 ts_tablet_manager.cc:1905] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:52.681887 29544 ts_tablet_manager.cc:1905] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:52.688743 29543 tablet_replica.cc:330] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: stopping tablet replica
I20260812 11:17:52.688977 29543 raft_consensus.cc:2229] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:52.689431 29543 raft_consensus.cc:2258] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:52.691131 29545 ts_tablet_manager.cc:1918] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:52.691294 29545 log.cc:1196] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/969b4c1fa1a74ce5832df66f94afeb7f
I20260812 11:17:52.691812 29545 ts_tablet_manager.cc:1939] T 969b4c1fa1a74ce5832df66f94afeb7f P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting consensus metadata
I20260812 11:17:52.692525 29544 ts_tablet_manager.cc:1918] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:52.692670 29544 log.cc:1196] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/969b4c1fa1a74ce5832df66f94afeb7f
I20260812 11:17:52.693212 29544 ts_tablet_manager.cc:1939] T 969b4c1fa1a74ce5832df66f94afeb7f P 41908367f6f447769796945e4595fa35: Deleting consensus metadata
I20260812 11:17:52.693171 28591 catalog_manager.cc:4841] TS 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207): tablet 969b4c1fa1a74ce5832df66f94afeb7f (table test-table [id=bb90ed63d5a5441f979d07488e846081]) successfully deleted
I20260812 11:17:52.694291 28592 catalog_manager.cc:4841] TS 41908367f6f447769796945e4595fa35 (127.15.164.193:40195): tablet 969b4c1fa1a74ce5832df66f94afeb7f (table test-table [id=bb90ed63d5a5441f979d07488e846081]) successfully deleted
I20260812 11:17:52.694798 29543 ts_tablet_manager.cc:1905] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:52.699688 29543 ts_tablet_manager.cc:1918] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:52.699843 29543 log.cc:1196] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/969b4c1fa1a74ce5832df66f94afeb7f
I20260812 11:17:52.700241 29543 ts_tablet_manager.cc:1939] T 969b4c1fa1a74ce5832df66f94afeb7f P f99269d03c0e4cd0b3a16d654e348939: Deleting consensus metadata
I20260812 11:17:52.701174 28592 catalog_manager.cc:4841] TS f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773): tablet 969b4c1fa1a74ce5832df66f94afeb7f (table test-table [id=bb90ed63d5a5441f979d07488e846081]) successfully deleted
Aug 12 11:17:52 dist-test-slave-7kzw krb5kdc[28545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:17:52 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:17:52 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:17:52.749495 29497 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:17:52.737084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39962 (local address 127.15.164.254:44015)
0812 11:17:52.737331 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.737340 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.737816 (+ 476us) server_negotiation.cc:407] Connection header received
0812 11:17:52.738089 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.738096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.738206 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.738320 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:52.739826 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.740993 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.742221 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.742944 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.743086 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.748548 (+ 5462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39962: BlockingRecv error: recv got EOF from 127.0.0.1:39962 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:17:52 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM
I20260812 11:17:52.768956 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.752203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39968 (local address 127.15.164.254:44015)
0812 11:17:52.752413 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.752419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.752900 (+ 481us) server_negotiation.cc:407] Connection header received
0812 11:17:52.753079 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.753084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.753152 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.753240 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:52.754825 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.755556 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.757421 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.757873 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.757974 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.762528 (+ 4554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:52.762539 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:52.762544 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:52.762591 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:52.765660 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:52.766532 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:52.766540 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:52.766544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:52.766714 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:52.767160 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:52.767168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:52.767172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:52.767587 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:52.767913 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.768255 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.768565 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:17:52.773129 28616 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:52.773862 28616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:52.781987 28839 tablet_service.cc:1467] Processing CreateTablet for tablet a6f25efa3154418da0774e732fe541d1 (DEFAULT_TABLE table=test-table [id=d5f24c9766924966bac320af0ebfea23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:52.782063 29052 tablet_service.cc:1467] Processing CreateTablet for tablet a6f25efa3154418da0774e732fe541d1 (DEFAULT_TABLE table=test-table [id=d5f24c9766924966bac320af0ebfea23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:52.782096 29298 tablet_service.cc:1467] Processing CreateTablet for tablet a6f25efa3154418da0774e732fe541d1 (DEFAULT_TABLE table=test-table [id=d5f24c9766924966bac320af0ebfea23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:52.782562 29298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f25efa3154418da0774e732fe541d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.782595 29052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f25efa3154418da0774e732fe541d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.782737 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6f25efa3154418da0774e732fe541d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:52.789386 29451 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Bootstrap starting.
I20260812 11:17:52.789588 29450 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Bootstrap starting.
I20260812 11:17:52.791057 29450 tablet_bootstrap.cc:654] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.791333 29451 tablet_bootstrap.cc:654] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.793390 29450 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: No bootstrap required, opened a new log
I20260812 11:17:52.793576 29450 ts_tablet_manager.cc:1397] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 11:17:52.794272 29450 raft_consensus.cc:348] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.794553 29450 raft_consensus.cc:374] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.794658 29450 raft_consensus.cc:729] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.794929 29450 consensus_queue.cc:260] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.795552 29450 ts_tablet_manager.cc:1428] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 11:17:52.796711 29451 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: No bootstrap required, opened a new log
I20260812 11:17:52.796880 29451 ts_tablet_manager.cc:1397] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260812 11:17:52.797708 29451 raft_consensus.cc:348] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.797973 29451 raft_consensus.cc:374] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.798074 29451 raft_consensus.cc:729] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.798573 29451 consensus_queue.cc:260] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.799979 29451 ts_tablet_manager.cc:1428] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:52.800601 29447 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Bootstrap starting.
I20260812 11:17:52.802354 29447 tablet_bootstrap.cc:654] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:52.806890 29447 tablet_bootstrap.cc:492] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: No bootstrap required, opened a new log
I20260812 11:17:52.807103 29447 ts_tablet_manager.cc:1397] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20260812 11:17:52.807992 29447 raft_consensus.cc:348] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.808312 29447 raft_consensus.cc:374] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:52.808411 29447 raft_consensus.cc:729] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41908367f6f447769796945e4595fa35, State: Initialized, Role: FOLLOWER
I20260812 11:17:52.808660 29447 consensus_queue.cc:260] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.809291 29447 ts_tablet_manager.cc:1428] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:17:52.967068 29535 raft_consensus.cc:482] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:52.967325 29535 raft_consensus.cc:504] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.968230 29535 leader_election.cc:288] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207)
I20260812 11:17:52.968840 28870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f25efa3154418da0774e732fe541d1" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35" is_pre_election: true
I20260812 11:17:52.968892 29090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f25efa3154418da0774e732fe541d1" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" is_pre_election: true
I20260812 11:17:52.969130 28870 raft_consensus.cc:2454] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:52.969192 29090 raft_consensus.cc:2454] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 0.
I20260812 11:17:52.969735 29217 leader_election.cc:302] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75233e3c76214d0fb6f4d95c6a8c0d77, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:52.970094 29535 raft_consensus.cc:2781] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:52.970237 29535 raft_consensus.cc:482] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:52.970330 29535 raft_consensus.cc:3037] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.973694 29535 raft_consensus.cc:504] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.974435 29535 leader_election.cc:288] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Requested vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207)
I20260812 11:17:52.975078 29090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f25efa3154418da0774e732fe541d1" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77"
I20260812 11:17:52.975102 28870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6f25efa3154418da0774e732fe541d1" candidate_uuid: "f99269d03c0e4cd0b3a16d654e348939" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35"
I20260812 11:17:52.975304 29090 raft_consensus.cc:3037] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.975349 28870 raft_consensus.cc:3037] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:52.978157 28870 raft_consensus.cc:2454] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:52.978670 29219 leader_election.cc:302] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41908367f6f447769796945e4595fa35, f99269d03c0e4cd0b3a16d654e348939; no voters:
I20260812 11:17:52.978808 29090 raft_consensus.cc:2454] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99269d03c0e4cd0b3a16d654e348939 in term 1.
I20260812 11:17:52.979089 29535 raft_consensus.cc:2781] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:52.979465 29535 raft_consensus.cc:686] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Becoming Leader. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Running, Role: LEADER
I20260812 11:17:52.979871 29535 consensus_queue.cc:237] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:52.982888 28616 catalog_manager.cc:5495] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 reported cstate change: term changed from 0 to 1, leader changed from <none> to f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195). New cstate: current_term: 1 leader_uuid: "f99269d03c0e4cd0b3a16d654e348939" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } health_report { overall_health: HEALTHY } } }
I20260812 11:17:53.000272 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:52.994325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45236 (local address 127.15.164.195:36773)
0812 11:17:52.994646 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:52.994654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:52.994817 (+ 163us) server_negotiation.cc:407] Connection header received
0812 11:17:52.995075 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:52.995079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:52.995177 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:52.995294 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:52.995693 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.996739 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.998288 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:52.998812 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:52.998967 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:52.999449 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:52.999575 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:52.999683 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:52.999874 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 11:17:52.999960 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260812 11:17:53.003033 28870 raft_consensus.cc:1261] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Refusing update from remote peer f99269d03c0e4cd0b3a16d654e348939: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:53.003087 29090 raft_consensus.cc:1261] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Refusing update from remote peer f99269d03c0e4cd0b3a16d654e348939: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:53.003820 29472 consensus_queue.cc:1035] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:53.004101 29535 consensus_queue.cc:1035] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:53.018934 28616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:53.019227 28616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:53.022250 28616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Sending DeleteTablet for 3 replicas of tablet a6f25efa3154418da0774e732fe541d1
I20260812 11:17:53.023140 28839 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f25efa3154418da0774e732fe541d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59578
I20260812 11:17:53.023267 29052 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f25efa3154418da0774e732fe541d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57760
I20260812 11:17:53.023447 29298 tablet_service.cc:1514] Processing DeleteTablet for tablet a6f25efa3154418da0774e732fe541d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 11:17:53.023520 29544 tablet_replica.cc:330] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: stopping tablet replica
I20260812 11:17:53.023550 29545 tablet_replica.cc:330] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: stopping tablet replica
I20260812 11:17:53.023720 29543 tablet_replica.cc:330] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: stopping tablet replica
I20260812 11:17:53.023731 29544 raft_consensus.cc:2229] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:53.023768 29545 raft_consensus.cc:2229] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:53.023921 29543 raft_consensus.cc:2229] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:53.023975 29544 raft_consensus.cc:2258] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.023975 29545 raft_consensus.cc:2258] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.024334 29543 raft_consensus.cc:2258] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.024398 28616 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:17:53.025094 28616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:17:53.025347 29545 ts_tablet_manager.cc:1905] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.025408 29543 ts_tablet_manager.cc:1905] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.027443 29544 ts_tablet_manager.cc:1905] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.031919 29545 ts_tablet_manager.cc:1918] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:53.032096 29545 log.cc:1196] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/a6f25efa3154418da0774e732fe541d1
I20260812 11:17:53.032584 29545 ts_tablet_manager.cc:1939] T a6f25efa3154418da0774e732fe541d1 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting consensus metadata
I20260812 11:17:53.033020 29052 tablet_service.cc:1467] Processing CreateTablet for tablet f77167a9866544208c1fabc0eb17d397 (DEFAULT_TABLE table=test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:53.033433 29052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77167a9866544208c1fabc0eb17d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:53.033962 29544 ts_tablet_manager.cc:1918] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:53.034122 29544 log.cc:1196] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/a6f25efa3154418da0774e732fe541d1
I20260812 11:17:53.034897 29544 ts_tablet_manager.cc:1939] T a6f25efa3154418da0774e732fe541d1 P 41908367f6f447769796945e4595fa35: Deleting consensus metadata
I20260812 11:17:53.034933 28839 tablet_service.cc:1467] Processing CreateTablet for tablet f77167a9866544208c1fabc0eb17d397 (DEFAULT_TABLE table=test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:53.035454 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77167a9866544208c1fabc0eb17d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:53.036746 28592 catalog_manager.cc:4841] TS 41908367f6f447769796945e4595fa35 (127.15.164.193:40195): tablet a6f25efa3154418da0774e732fe541d1 (table test-table [id=d5f24c9766924966bac320af0ebfea23]) successfully deleted
I20260812 11:17:53.037019 29298 tablet_service.cc:1467] Processing CreateTablet for tablet f77167a9866544208c1fabc0eb17d397 (DEFAULT_TABLE table=test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:17:53.037483 29298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f77167a9866544208c1fabc0eb17d397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:53.036805 28591 catalog_manager.cc:4841] TS 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207): tablet a6f25efa3154418da0774e732fe541d1 (table test-table [id=d5f24c9766924966bac320af0ebfea23]) successfully deleted
I20260812 11:17:53.040269 29450 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Bootstrap starting.
I20260812 11:17:53.041426 29447 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Bootstrap starting.
I20260812 11:17:53.042303 29450 tablet_bootstrap.cc:654] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:53.042655 29543 ts_tablet_manager.cc:1918] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:17:53.042819 29543 log.cc:1196] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/a6f25efa3154418da0774e732fe541d1
I20260812 11:17:53.043246 29543 ts_tablet_manager.cc:1939] T a6f25efa3154418da0774e732fe541d1 P f99269d03c0e4cd0b3a16d654e348939: Deleting consensus metadata
I20260812 11:17:53.043264 29447 tablet_bootstrap.cc:654] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:53.044350 29451 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Bootstrap starting.
I20260812 11:17:53.044544 28592 catalog_manager.cc:4841] TS f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773): tablet a6f25efa3154418da0774e732fe541d1 (table test-table [id=d5f24c9766924966bac320af0ebfea23]) successfully deleted
I20260812 11:17:53.046113 29451 tablet_bootstrap.cc:654] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:53.046694 29450 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: No bootstrap required, opened a new log
I20260812 11:17:53.046891 29450 ts_tablet_manager.cc:1397] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260812 11:17:53.047878 29447 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: No bootstrap required, opened a new log
I20260812 11:17:53.048059 29447 ts_tablet_manager.cc:1397] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:17:53.047900 29450 raft_consensus.cc:348] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.048378 29451 tablet_bootstrap.cc:492] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: No bootstrap required, opened a new log
I20260812 11:17:53.048465 29450 raft_consensus.cc:374] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:53.048548 29451 ts_tablet_manager.cc:1397] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 11:17:53.048568 29450 raft_consensus.cc:729] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Initialized, Role: FOLLOWER
I20260812 11:17:53.048869 29450 consensus_queue.cc:260] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.048894 29447 raft_consensus.cc:348] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.049146 29447 raft_consensus.cc:374] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:53.049238 29447 raft_consensus.cc:729] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41908367f6f447769796945e4595fa35, State: Initialized, Role: FOLLOWER
I20260812 11:17:53.049518 29447 consensus_queue.cc:260] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.049350 29451 raft_consensus.cc:348] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.049887 29451 raft_consensus.cc:374] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:53.049968 29451 raft_consensus.cc:729] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99269d03c0e4cd0b3a16d654e348939, State: Initialized, Role: FOLLOWER
I20260812 11:17:53.050239 29451 consensus_queue.cc:260] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.051167 29447 ts_tablet_manager.cc:1428] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:17:53.051771 29451 ts_tablet_manager.cc:1428] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:53.052021 29450 ts_tablet_manager.cc:1428] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260812 11:17:53.195494 29527 raft_consensus.cc:482] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:17:53.195748 29527 raft_consensus.cc:504] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.196419 29527 leader_election.cc:288] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773)
I20260812 11:17:53.197175 28870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77167a9866544208c1fabc0eb17d397" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35" is_pre_election: true
I20260812 11:17:53.197220 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77167a9866544208c1fabc0eb17d397" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f99269d03c0e4cd0b3a16d654e348939" is_pre_election: true
I20260812 11:17:53.197453 28870 raft_consensus.cc:2454] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 0.
I20260812 11:17:53.197453 29329 raft_consensus.cc:2454] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 0.
I20260812 11:17:53.197947 28983 leader_election.cc:302] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41908367f6f447769796945e4595fa35, 75233e3c76214d0fb6f4d95c6a8c0d77; no voters:
I20260812 11:17:53.198251 29527 raft_consensus.cc:2781] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:17:53.198390 29527 raft_consensus.cc:482] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:17:53.198558 29527 raft_consensus.cc:3037] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:53.200661 29527 raft_consensus.cc:504] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.201198 29527 leader_election.cc:288] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 election: Requested vote from peers 41908367f6f447769796945e4595fa35 (127.15.164.193:40195), f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773)
I20260812 11:17:53.201790 29329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77167a9866544208c1fabc0eb17d397" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f99269d03c0e4cd0b3a16d654e348939"
I20260812 11:17:53.201817 28870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77167a9866544208c1fabc0eb17d397" candidate_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41908367f6f447769796945e4595fa35"
I20260812 11:17:53.202009 28870 raft_consensus.cc:3037] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:53.202004 29329 raft_consensus.cc:3037] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:53.204071 29329 raft_consensus.cc:2454] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 1.
I20260812 11:17:53.204095 28870 raft_consensus.cc:2454] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75233e3c76214d0fb6f4d95c6a8c0d77 in term 1.
I20260812 11:17:53.204514 28983 leader_election.cc:302] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41908367f6f447769796945e4595fa35, 75233e3c76214d0fb6f4d95c6a8c0d77; no voters:
I20260812 11:17:53.204818 29527 raft_consensus.cc:2781] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:53.205243 29527 raft_consensus.cc:686] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 LEADER]: Becoming Leader. State: Replica: 75233e3c76214d0fb6f4d95c6a8c0d77, State: Running, Role: LEADER
I20260812 11:17:53.205552 29527 consensus_queue.cc:237] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } }
I20260812 11:17:53.208760 28616 catalog_manager.cc:5495] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75233e3c76214d0fb6f4d95c6a8c0d77" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 } health_report { overall_health: UNKNOWN } } }
I20260812 11:17:53.257336 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.252374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57774 (local address 127.15.164.194:38207)
0812 11:17:53.252900 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:53.252905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:53.252921 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:17:53.252973 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:53.252977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:53.253037 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:53.253143 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:53.253488 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.254229 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.255608 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.256016 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.256149 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.256628 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:53.256743 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:53.256831 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:53.256988 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:17:53.257072 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":285,"threads_started":1}
I20260812 11:17:53.272259 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.266362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:57363 (local address 127.15.164.194:38207)
0812 11:17:53.266571 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:53.266575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:53.267229 (+ 654us) server_negotiation.cc:407] Connection header received
0812 11:17:53.267463 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:53.267470 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:53.267537 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:53.267637 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:17:53.268122 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.268906 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.270512 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.270933 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.271092 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.271484 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:17:53.271584 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:17:53.271696 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:53.271839 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:17:53.271910 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:17:53.272323 29595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.266364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38207 (local address 127.15.164.194:57363)
0812 11:17:53.267090 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:53.267112 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:53.267319 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:53.267663 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:53.267668 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:53.267680 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:17:53.267971 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:53.267980 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.269066 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.269073 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:53.270314 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:53.270327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.271116 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.271122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:53.271274 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.271309 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:17:53.271696 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:17:53.271711 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 11:17:53.271820 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:17:53.271957 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":457,"threads_started":1}
I20260812 11:17:53.281694 29329 raft_consensus.cc:1261] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Refusing update from remote peer 75233e3c76214d0fb6f4d95c6a8c0d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:53.281694 28870 raft_consensus.cc:1261] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Refusing update from remote peer 75233e3c76214d0fb6f4d95c6a8c0d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:17:53.282251 29527 consensus_queue.cc:1035] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41908367f6f447769796945e4595fa35" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:53.282620 29591 consensus_queue.cc:1035] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f99269d03c0e4cd0b3a16d654e348939" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:17:53.288722 29518 mvcc.cc:205] Tried to move back new op lower bound from 7317641106557071360 to 7317641106251968512. Current Snapshot: MvccSnapshot[applied={T|T < 7317641106557071360}]
I20260812 11:17:53.353192 28616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:53.353521 28616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:17:53.356812 28616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9deee6d2a217412f8237fa33573ade15: Sending DeleteTablet for 3 replicas of tablet f77167a9866544208c1fabc0eb17d397
I20260812 11:17:53.357888 28839 tablet_service.cc:1514] Processing DeleteTablet for tablet f77167a9866544208c1fabc0eb17d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59578
I20260812 11:17:53.357973 29298 tablet_service.cc:1514] Processing DeleteTablet for tablet f77167a9866544208c1fabc0eb17d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:45226
I20260812 11:17:53.358264 29544 tablet_replica.cc:330] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: stopping tablet replica
I20260812 11:17:53.358299 29543 tablet_replica.cc:330] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: stopping tablet replica
I20260812 11:17:53.358449 29544 raft_consensus.cc:2229] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:53.358508 29543 raft_consensus.cc:2229] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:17:53.358753 29543 raft_consensus.cc:2258] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.358734 29544 raft_consensus.cc:2258] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.359642 29053 tablet_service.cc:1514] Processing DeleteTablet for tablet f77167a9866544208c1fabc0eb17d397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:17:53 UTC) from {username='oryx', principal='oryx/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57760
I20260812 11:17:53.359951 29545 tablet_replica.cc:330] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: stopping tablet replica
I20260812 11:17:53.360159 29545 raft_consensus.cc:2229] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:17:53.360621 29543 ts_tablet_manager.cc:1905] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.360755 29545 raft_consensus.cc:2258] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:17:53.361095 29544 ts_tablet_manager.cc:1905] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.362191 29545 ts_tablet_manager.cc:1905] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:17:53.367722 29543 ts_tablet_manager.cc:1918] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:53.367903 29544 ts_tablet_manager.cc:1918] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:53.368046 29544 log.cc:1196] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/f77167a9866544208c1fabc0eb17d397
I20260812 11:17:53.368233 29543 log.cc:1196] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/f77167a9866544208c1fabc0eb17d397
I20260812 11:17:53.368539 29544 ts_tablet_manager.cc:1939] T f77167a9866544208c1fabc0eb17d397 P 41908367f6f447769796945e4595fa35: Deleting consensus metadata
I20260812 11:17:53.368799 29543 ts_tablet_manager.cc:1939] T f77167a9866544208c1fabc0eb17d397 P f99269d03c0e4cd0b3a16d654e348939: Deleting consensus metadata
I20260812 11:17:53.369262 29545 ts_tablet_manager.cc:1918] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:17:53.369415 29545 log.cc:1196] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/f77167a9866544208c1fabc0eb17d397
I20260812 11:17:53.369791 28592 catalog_manager.cc:4841] TS 41908367f6f447769796945e4595fa35 (127.15.164.193:40195): tablet f77167a9866544208c1fabc0eb17d397 (table test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]) successfully deleted
I20260812 11:17:53.369856 29545 ts_tablet_manager.cc:1939] T f77167a9866544208c1fabc0eb17d397 P 75233e3c76214d0fb6f4d95c6a8c0d77: Deleting consensus metadata
I20260812 11:17:53.370543 28592 catalog_manager.cc:4841] TS f99269d03c0e4cd0b3a16d654e348939 (127.15.164.195:36773): tablet f77167a9866544208c1fabc0eb17d397 (table test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]) successfully deleted
I20260812 11:17:53.371133 28591 catalog_manager.cc:4841] TS 75233e3c76214d0fb6f4d95c6a8c0d77 (127.15.164.194:38207): tablet f77167a9866544208c1fabc0eb17d397 (table test-table [id=c9c513eab0bb4a78b56fcd4d08db15cf]) successfully deleted
I20260812 11:17:53.371860 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 28729
Aug 12 11:17:53 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.193@KRBTEST.COM
I20260812 11:17:53.389263 29601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.372771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46012 (local address 127.15.164.193:40195)
0812 11:17:53.373227 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:53.373234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:53.373544 (+ 310us) server_negotiation.cc:407] Connection header received
0812 11:17:53.373705 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:53.373710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:53.373795 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:53.373912 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:53.375103 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.376277 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.377828 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.378325 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.378532 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.383208 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:53.383223 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:53.383241 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:53.383280 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:53.386313 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.387103 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.387119 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.387121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.387253 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.387659 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.387663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.387665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.388013 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:53.388364 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:53.388690 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:17:53.388921 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":230,"threads_started":1}
I20260812 11:17:53.389936 28934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:53.518944 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 28729
I20260812 11:17:53.551843 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 28945
Aug 12 11:17:53 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.194@KRBTEST.COM
I20260812 11:17:53.568154 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.552835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47804 (local address 127.15.164.194:38207)
0812 11:17:53.553005 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:53.553011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:53.553032 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:17:53.553156 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:53.553163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:53.553241 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:53.553354 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:53.554685 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.555446 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.556693 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.557173 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.557322 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.561786 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:53.561813 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:53.561830 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:53.561873 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:53.565103 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.565821 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.565830 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.565832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.565995 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.566401 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.566408 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.566416 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.566856 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:53.567233 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:53.567516 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 11:17:53.567756 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:17:53.568924 29163 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:53.731868 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 28945
W20260812 11:17:53.767521 29219 connection.cc:535] server connection from 127.15.164.194:38681 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:17:53.767990 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 29179
Aug 12 11:17:53 dist-test-slave-7kzw krb5kdc[28545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.164.195@KRBTEST.COM
I20260812 11:17:53.784579 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:53.768716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42374 (local address 127.15.164.195:36773)
0812 11:17:53.769217 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:53.769222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:53.769241 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:17:53.769304 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:53.769307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:53.769386 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:53.769556 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:53.770959 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.771759 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.773365 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:53.773818 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:53.773929 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:53.778807 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:53.778824 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:53.778843 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:53.778881 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:53.781871 (+ 2990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.782614 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.782622 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.782624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.782795 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:53.783134 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:53.783137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:53.783140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:53.783497 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:53.783757 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:53.784025 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 11:17:53.784208 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":268,"threads_started":1}
I20260812 11:17:53.785238 29401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:53.914332 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 29179
I20260812 11:17:53.947340 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 28563
I20260812 11:17:53.948655 28681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:17:54.067649 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 28563
2026-08-12T11:17:54Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6676 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:54 dist-test-slave-7kzw krb5kdc[29616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:54 dist-test-slave-7kzw krb5kdc[29616](info): set up 2 sockets
Aug 12 11:17:54 dist-test-slave-7kzw krb5kdc[29616](info): commencing operation
krb5kdc: starting...
W20260812 11:17:55.482190 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.357s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:55 dist-test-slave-7kzw krb5kdc[29616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:55.771634 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41813
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:40635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:56.132196 29635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:56.132577 29635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:56.132756 29635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:56.140225 29635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:56.140389 29635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:56.140512 29635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:56.140617 29635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:56.140712 29635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:56.151036 29635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:40635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:56.152522 29635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:56.153894 29635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:56.166802 29642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:56.166837 29643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:56.166860 29645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:56.168658 29635 server_base.cc:1034] running on GCE node
I20260812 11:17:56.169667 29635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:56.171427 29635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:56.172699 29635 hybrid_clock.cc:648] HybridClock initialized: now 1786533476172643 us; error 53 us; skew 500 ppm
I20260812 11:17:56.173096 29635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T11:17:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2168 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:17:56 dist-test-slave-7kzw krb5kdc[29656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:17:56 dist-test-slave-7kzw krb5kdc[29656](info): set up 2 sockets
Aug 12 11:17:56 dist-test-slave-7kzw krb5kdc[29656](info): commencing operation
krb5kdc: starting...
W20260812 11:17:57.647042 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.352s user 0.007s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:17:57 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:17:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:17:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:17:57.934764 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41211
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:58.285149 29678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:58.285457 29678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:58.285627 29678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:58.293062 29678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:17:58.293182 29678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:58.293295 29678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:58.293393 29678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:17:58.293463 29678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:17:58.303865 29678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:58.305322 29678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:58.306825 29678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:58.319559 29684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:58.319725 29688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:58.319607 29686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:58.320973 29678 server_base.cc:1034] running on GCE node
I20260812 11:17:58.321941 29678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:58.323594 29678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:58.324847 29678 hybrid_clock.cc:648] HybridClock initialized: now 1786533478324754 us; error 69 us; skew 500 ppm
I20260812 11:17:58.325284 29678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:58 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533478, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:58.333986 29678 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:17:58.335850 29678 webserver.cc:460] Webserver started at http://127.15.164.254:44965/ using document root <none> and password file <none>
I20260812 11:17:58.336694 29678 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:58.336869 29678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:58.337260 29678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:58.340782 29678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "9df0ae21e38c4fd2921e53018a2cbd10"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "d9030b0a3e6197f4c11642625fb75f8d"
server_key_iv: "85545f99097109364ae7c2296b3d8510"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.341681 29678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "9df0ae21e38c4fd2921e53018a2cbd10"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "d9030b0a3e6197f4c11642625fb75f8d"
server_key_iv: "85545f99097109364ae7c2296b3d8510"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.347986 29678 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:17:58.352104 29701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:58.353919 29678 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:17:58.354187 29678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "9df0ae21e38c4fd2921e53018a2cbd10"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "d9030b0a3e6197f4c11642625fb75f8d"
server_key_iv: "85545f99097109364ae7c2296b3d8510"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.354446 29678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:58.371416 29678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:58.376317 29678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:58.376621 29678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:58.397850 29678 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41211
I20260812 11:17:58.397847 29795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41211 every 8 connection(s)
I20260812 11:17:58.399771 29678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:17:58.404281 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 29678
I20260812 11:17:58.404532 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:17:58.405052 29796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:17:58.405463 16019 external_mini_cluster.cc:1428] Setting key f3292120144bbddeeb3c6848759d75a7
I20260812 11:17:58.420042 29796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Bootstrap starting.
Aug 12 11:17:58 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:58.423810 29796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Neither blocks nor log segments found. Creating new log.
I20260812 11:17:58.425289 29796 log.cc:824] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Log is configured to *not* fsync() on all Append() calls
I20260812 11:17:58.429185 29796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: No bootstrap required, opened a new log
I20260812 11:17:58.433910 29801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:58.407918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48738 (local address 127.15.164.254:41211)
0812 11:17:58.408904 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:58.408917 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:58.408968 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:17:58.410926 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:58.410954 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:58.411431 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:58.411923 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:58.413732 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:58.415444 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:58.416955 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:58.417973 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:58.418663 (+ 690us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:58.424376 (+ 5713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:58.424389 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:58.424410 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:58.424465 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:58.428776 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:58.429710 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:58.429722 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:58.429731 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:58.429964 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:58.430367 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:58.430373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:58.430376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:58.431153 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:58.431494 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:58.431939 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 11:17:58.432452 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":432,"threads_started":1}
I20260812 11:17:58.439267 29796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:17:58.439631 29796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:17:58.439720 29796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9df0ae21e38c4fd2921e53018a2cbd10, State: Initialized, Role: FOLLOWER
I20260812 11:17:58.440320 29796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:17:58.440539 29796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:17:58.440656 29796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:17:58.440798 29796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:17:58.443389 29796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:17:58.443907 29796 leader_election.cc:302] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9df0ae21e38c4fd2921e53018a2cbd10; no voters:
I20260812 11:17:58.444510 29796 leader_election.cc:288] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:17:58.444725 29804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:17:58.445607 29804 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 LEADER]: Becoming Leader. State: Replica: 9df0ae21e38c4fd2921e53018a2cbd10, State: Running, Role: LEADER
I20260812 11:17:58.446192 29804 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:17:58.446972 29796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:17:58.449738 29805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } } }
I20260812 11:17:58.450001 29806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9df0ae21e38c4fd2921e53018a2cbd10. Latest consensus state: current_term: 1 leader_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } } }
I20260812 11:17:58.450263 29805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:58.450358 29806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: This master's current role is: LEADER
I20260812 11:17:58.452848 29816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:17:58.457471 29816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:17:58.466964 29816 catalog_manager.cc:1347] Generated new cluster ID: 985adf1138d04642b1603963d012e430
I20260812 11:17:58.467123 29816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:17:58.475219 29816 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:17:58.476612 29816 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:17:58.485384 29816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Generated new TSK 0
I20260812 11:17:58.486227 29816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:17:58.558116 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:58.913560 29835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:58.913895 29835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:58.914031 29835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:58.921761 29835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:58.921898 29835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:58.922077 29835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:17:58.933391 29835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:58.935060 29835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:58.936482 29835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:58.951337 29844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:58.951357 29845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:58.951574 29847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:58.952965 29835 server_base.cc:1034] running on GCE node
I20260812 11:17:58.953816 29835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:58.955124 29835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:58.956439 29835 hybrid_clock.cc:648] HybridClock initialized: now 1786533478956344 us; error 73 us; skew 500 ppm
I20260812 11:17:58.956905 29835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:58 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533478, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:58.960922 29835 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:17:58.962699 29835 webserver.cc:460] Webserver started at http://127.15.164.193:36099/ using document root <none> and password file <none>
I20260812 11:17:58.963455 29835 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:58.963616 29835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:58.963923 29835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:58.967377 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "085d436a87d64faea26fab951595d6e9"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "36f41c1550473fe58b5ed68795e3309a"
server_key_iv: "a9ce7b688cf953004d422ca4f29e1a77"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.968257 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "085d436a87d64faea26fab951595d6e9"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "36f41c1550473fe58b5ed68795e3309a"
server_key_iv: "a9ce7b688cf953004d422ca4f29e1a77"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.974063 29835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 11:17:58.978071 29858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:58.979614 29835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:17:58.979817 29835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "085d436a87d64faea26fab951595d6e9"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "36f41c1550473fe58b5ed68795e3309a"
server_key_iv: "a9ce7b688cf953004d422ca4f29e1a77"
server_key_version: "encryptionkey@0"
I20260812 11:17:58.980050 29835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:59.003960 29835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:59.008817 29835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:59.009159 29835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:59.010253 29835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:59.011802 29835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:59.011917 29835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:59.012081 29835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:59.012167 29835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:59.050595 29835 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:36995
I20260812 11:17:59.050640 30031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:36995 every 8 connection(s)
I20260812 11:17:59.052220 29835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:17:59.057904 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 29835
I20260812 11:17:59.058128 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:17:59.059055 16019 external_mini_cluster.cc:1428] Setting key 1cde363f7a6d15cfa174fcadbfc91ab0
Aug 12 11:17:59 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533478, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:59.076923 30035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:59.054995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:54819 (local address 127.15.164.254:41211)
0812 11:17:59.055451 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:59.055456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:59.056566 (+ 1110us) server_negotiation.cc:407] Connection header received
0812 11:17:59.059738 (+ 3172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:59.059744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:59.059893 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:59.060042 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:59.062264 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.063141 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.065688 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.066096 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.066209 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:59.070891 (+ 4682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:59.070896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:59.070900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:59.070937 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:59.073643 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:59.074428 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:59.074434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:59.074437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:59.074626 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:59.075080 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:59.075085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:59.075089 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:59.075380 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:59.075547 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:59.076292 (+ 745us) server_negotiation.cc:299] Negotiation successful
0812 11:17:59.076528 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":233,"threads_started":1}
I20260812 11:17:59.077982 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:59.055539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:54819)
0812 11:17:59.056350 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:59.056395 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:59.059355 (+ 2960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:59.060365 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:59.060377 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:59.061167 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:59.062040 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:59.062072 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.063312 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.063321 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:59.065505 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:59.065525 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.066347 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.066357 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:59.066727 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:59.067577 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:59.067614 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:59.070642 (+ 3028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:59.073803 (+ 3161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:59.073813 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:59.073832 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:59.074299 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:59.074752 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:59.074757 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:59.074761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:59.074959 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:59.075527 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:59.075535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:59.075904 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 11:17:59.076197 (+ 293us) client_negotiation.cc:240] Negotiation successful
0812 11:17:59.076772 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":326,"threads_started":1}
I20260812 11:17:59.079840 30033 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41211
I20260812 11:17:59.080211 30033 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:59.081215 30033 heartbeater.cc:511] Master 127.15.164.254:41211 requested a full tablet report, sending...
I20260812 11:17:59.084097 29737 ts_manager.cc:194] Registered new tserver with Master: 085d436a87d64faea26fab951595d6e9 (127.15.164.193:36995)
I20260812 11:17:59.085819 29737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:54819
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:17:59.127873 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:17:59.490643 30039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:17:59.490943 30039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:17:59.491042 30039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:17:59.498240 30039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:17:59.498356 30039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:17:59.498517 30039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:17:59.508476 30039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:17:59.509819 30039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:17:59.511149 30039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:17:59.524947 30053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:59.524976 30055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:17:59.525000 30057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:17:59.526072 30039 server_base.cc:1034] running on GCE node
I20260812 11:17:59.526841 30039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:17:59.527874 30039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:17:59.529121 30039 hybrid_clock.cc:648] HybridClock initialized: now 1786533479529049 us; error 63 us; skew 500 ppm
I20260812 11:17:59.529470 30039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:17:59 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533479, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:17:59.532891 30039 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:17:59.534538 30039 webserver.cc:460] Webserver started at http://127.15.164.194:37509/ using document root <none> and password file <none>
I20260812 11:17:59.535316 30039 fs_manager.cc:359] Metadata directory not provided
I20260812 11:17:59.535463 30039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:17:59.535797 30039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:17:59.538946 30039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "895afd07632d41abb7d18567e7be3b5c"
format_stamp: "Formatted at 2026-08-12 11:17:59 on dist-test-slave-7kzw"
server_key: "a1aef97d61f5eb8d05ffb50ec0df0f89"
server_key_iv: "4f4c57d74a5ad3912dc3b356540a6a24"
server_key_version: "encryptionkey@0"
I20260812 11:17:59.539794 30039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "895afd07632d41abb7d18567e7be3b5c"
format_stamp: "Formatted at 2026-08-12 11:17:59 on dist-test-slave-7kzw"
server_key: "a1aef97d61f5eb8d05ffb50ec0df0f89"
server_key_iv: "4f4c57d74a5ad3912dc3b356540a6a24"
server_key_version: "encryptionkey@0"
I20260812 11:17:59.545619 30039 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:17:59.549988 30068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:59.551810 30039 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:17:59.551973 30039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "895afd07632d41abb7d18567e7be3b5c"
format_stamp: "Formatted at 2026-08-12 11:17:59 on dist-test-slave-7kzw"
server_key: "a1aef97d61f5eb8d05ffb50ec0df0f89"
server_key_iv: "4f4c57d74a5ad3912dc3b356540a6a24"
server_key_version: "encryptionkey@0"
I20260812 11:17:59.552218 30039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:17:59.576179 30039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:17:59.581151 30039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:17:59.581480 30039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:17:59.582646 30039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:17:59.584286 30039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:17:59.584369 30039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:59.584517 30039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:17:59.584574 30039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:17:59.621609 30039 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46075
I20260812 11:17:59.621718 30261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46075 every 8 connection(s)
I20260812 11:17:59.623054 30039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:17:59.627775 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 30039
I20260812 11:17:59.627969 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:17:59.628459 16019 external_mini_cluster.cc:1428] Setting key 8b84d3574bdfc1a72fd59f24eaf525a3
Aug 12 11:17:59 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533479, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:17:59.647348 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:59.625853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:51149 (local address 127.15.164.254:41211)
0812 11:17:59.626401 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 11:17:59.626406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:17:59.627388 (+ 982us) server_negotiation.cc:407] Connection header received
0812 11:17:59.629840 (+ 2452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:17:59.629845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:17:59.629923 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:17:59.630022 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:17:59.632185 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.632947 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.634722 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.635227 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.635394 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:59.639475 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:17:59.639482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:17:59.639486 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:17:59.639529 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:17:59.643241 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:59.644381 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:59.644398 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:59.644401 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:59.644560 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:17:59.645164 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:17:59.645168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:17:59.645170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:17:59.645501 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:17:59.645665 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:17:59.646690 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0812 11:17:59.646993 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":310,"threads_started":1}
I20260812 11:17:59.648883 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:17:59.626297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:51149)
0812 11:17:59.627147 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0812 11:17:59.627210 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:17:59.629475 (+ 2265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:17:59.630334 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:17:59.630346 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:17:59.631174 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:17:59.631978 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:59.632007 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.633134 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.633146 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:59.634555 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:17:59.634572 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:17:59.635503 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:17:59.635512 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:17:59.635807 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:17:59.636613 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:17:59.636642 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:17:59.639145 (+ 2503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:17:59.643439 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:59.643453 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:59.643477 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:59.644214 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:59.644699 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:17:59.644706 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:17:59.644713 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:17:59.645025 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:17:59.645649 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:17:59.645662 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:17:59.646177 (+ 515us) client_negotiation.cc:769] Sending connection context
0812 11:17:59.646573 (+ 396us) client_negotiation.cc:240] Negotiation successful
0812 11:17:59.647236 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":345,"threads_started":1}
I20260812 11:17:59.650697 30264 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41211
I20260812 11:17:59.651067 30264 heartbeater.cc:464] Registering TS with master...
I20260812 11:17:59.651994 30264 heartbeater.cc:511] Master 127.15.164.254:41211 requested a full tablet report, sending...
I20260812 11:17:59.653699 29737 ts_manager.cc:194] Registered new tserver with Master: 895afd07632d41abb7d18567e7be3b5c (127.15.164.194:46075)
I20260812 11:17:59.654670 29737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:51149
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:17:59.698318 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:00.060734 30273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:00.061100 30273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:00.061268 30273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:00.068742 30273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:00.068918 30273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:00.069095 30273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:18:00.079478 30273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:00.080945 30273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:00.082370 30273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:18:00.089884 30033 heartbeater.cc:503] Master 127.15.164.254:41211 was elected leader, sending a full tablet report...
W20260812 11:18:00.097203 30283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:00.097255 30287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:00.097873 30284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:00.098392 30273 server_base.cc:1034] running on GCE node
I20260812 11:18:00.099182 30273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:00.101560 30273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:00.102820 30273 hybrid_clock.cc:648] HybridClock initialized: now 1786533480102771 us; error 58 us; skew 500 ppm
I20260812 11:18:00.103219 30273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:00 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533480, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:00.106992 30273 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:18:00.108636 30273 webserver.cc:460] Webserver started at http://127.15.164.195:39827/ using document root <none> and password file <none>
I20260812 11:18:00.109376 30273 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:00.109488 30273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:00.109782 30273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:00.113106 30273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "71ebf7f5491e4eac9096155d9d831752"
format_stamp: "Formatted at 2026-08-12 11:18:00 on dist-test-slave-7kzw"
server_key: "ee3fa24f04e727915ee70c37d30175c3"
server_key_iv: "be51753855fb2aed608a087efc1df40b"
server_key_version: "encryptionkey@0"
I20260812 11:18:00.113910 30273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "71ebf7f5491e4eac9096155d9d831752"
format_stamp: "Formatted at 2026-08-12 11:18:00 on dist-test-slave-7kzw"
server_key: "ee3fa24f04e727915ee70c37d30175c3"
server_key_iv: "be51753855fb2aed608a087efc1df40b"
server_key_version: "encryptionkey@0"
I20260812 11:18:00.119928 30273 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260812 11:18:00.124174 30297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:00.125994 30273 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:18:00.126176 30273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "71ebf7f5491e4eac9096155d9d831752"
format_stamp: "Formatted at 2026-08-12 11:18:00 on dist-test-slave-7kzw"
server_key: "ee3fa24f04e727915ee70c37d30175c3"
server_key_iv: "be51753855fb2aed608a087efc1df40b"
server_key_version: "encryptionkey@0"
I20260812 11:18:00.126379 30273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:00.141697 30273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:00.146871 30273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:00.147185 30273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:00.148444 30273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:00.150040 30273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:00.150120 30273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:00.150209 30273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:00.150259 30273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:00.187968 30273 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:45269
I20260812 11:18:00.188017 30502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:45269 every 8 connection(s)
I20260812 11:18:00.189385 30273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:18:00.198009 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 30273
I20260812 11:18:00.198238 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:18:00.198792 16019 external_mini_cluster.cc:1428] Setting key c41588652ecd0dbb74cd261df92b5fe9
Aug 12 11:18:00 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533480, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:18:00.215241 30509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:00.192294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:33919 (local address 127.15.164.254:41211)
0812 11:18:00.192819 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:00.192824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:00.193855 (+ 1031us) server_negotiation.cc:407] Connection header received
0812 11:18:00.195894 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:00.195900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:00.196010 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:00.196141 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:00.198079 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.199151 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.201531 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.202008 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.202177 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:00.206853 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:00.206859 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:00.206863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:00.206905 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:00.210099 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.211314 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.211319 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.211321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.211490 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.212423 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.212427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.212430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.212798 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:00.212942 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:00.214347 (+ 1405us) server_negotiation.cc:299] Negotiation successful
0812 11:18:00.214806 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":281,"threads_started":1}
I20260812 11:18:00.216491 30510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:00.192840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:33919)
0812 11:18:00.193651 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:00.193728 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:00.195577 (+ 1849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:00.196420 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:00.196430 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:00.196996 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:00.197744 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:00.197778 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.199424 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.199428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:00.201372 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:00.201389 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.202278 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.202284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:00.202664 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:00.203620 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:00.203689 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:00.206480 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:00.210407 (+ 3927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:00.210423 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:00.210441 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:00.211094 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:00.211686 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:00.211690 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:00.211692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:00.212237 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:00.212992 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:00.213002 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:00.213763 (+ 761us) client_negotiation.cc:769] Sending connection context
0812 11:18:00.214135 (+ 372us) client_negotiation.cc:240] Negotiation successful
0812 11:18:00.215080 (+ 945us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":328,"threads_started":1}
I20260812 11:18:00.218384 30505 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41211
I20260812 11:18:00.218783 30505 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:00.219580 30505 heartbeater.cc:511] Master 127.15.164.254:41211 requested a full tablet report, sending...
I20260812 11:18:00.221336 29737 ts_manager.cc:194] Registered new tserver with Master: 71ebf7f5491e4eac9096155d9d831752 (127.15.164.195:45269)
I20260812 11:18:00.222174 29737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:33919
I20260812 11:18:00.228482 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
Entry for principal oryx/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab.
WARNING: no policy specified for oryx/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
Entry for principal oryx/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab.
WARNING: no policy specified for oryx/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
Entry for principal oryx/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab.
I20260812 11:18:00.410912 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 29835
Aug 12 11:18:00 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:18:00.432024 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:00.412612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39974 (local address 127.15.164.193:36995)
0812 11:18:00.413688 (+ 1076us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:00.413698 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:00.413732 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:18:00.413814 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:00.413822 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:00.414054 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:00.414244 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:00.415925 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.417007 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.418421 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.419116 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.419238 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:00.424257 (+ 5019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:00.424276 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:00.424295 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:00.424339 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:00.428038 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.428908 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.428917 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.428919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.429065 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.429779 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.429791 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.429798 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.430595 (+ 797us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:00.430924 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:00.431326 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 11:18:00.431606 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":547,"threads_started":1}
I20260812 11:18:00.433492 30026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:00.524916 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 29835
I20260812 11:18:00.551627 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30039
Aug 12 11:18:00 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:18:00.570438 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:00.552607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43186 (local address 127.15.164.194:46075)
0812 11:18:00.553229 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:00.553239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:00.553267 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:18:00.553337 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:00.553344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:00.553566 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:00.553739 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:00.555148 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.556340 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.557792 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.558455 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.558752 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:00.563664 (+ 4912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:00.563676 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:00.563693 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:00.563743 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:00.566952 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.567989 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.568003 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.568008 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.568209 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.568761 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.568765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.568767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.569164 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:00.569420 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:00.569859 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 11:18:00.570100 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":313,"threads_started":1}
I20260812 11:18:00.572053 30256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:00.659368 30264 heartbeater.cc:503] Master 127.15.164.254:41211 was elected leader, sending a full tablet report...
I20260812 11:18:00.668386 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 30039
I20260812 11:18:00.692072 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30273
Aug 12 11:18:00 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:18:00.710760 30528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:00.693217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37620 (local address 127.15.164.195:45269)
0812 11:18:00.693799 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:00.693807 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:00.693842 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:18:00.693911 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:00.693919 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:00.694155 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:00.694348 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:00.695751 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.696800 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.698221 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:00.699038 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:00.699205 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:00.704051 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:00.704065 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:00.704083 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:00.704123 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:00.707374 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.708316 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.708325 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.708327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.708478 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:00.708952 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:00.708956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:00.708958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:00.709384 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:00.709658 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:00.710041 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 11:18:00.710304 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":264,"threads_started":1}
I20260812 11:18:00.712244 30493 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:00.800447 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 30273
I20260812 11:18:00.831426 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 29678
I20260812 11:18:00.832780 29789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:00.940398 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 29678
I20260812 11:18:00.974009 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41211
--webserver_interface=127.15.164.254
--webserver_port=44965
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:01.338083 30532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:01.338469 30532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:01.338697 30532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:01.346246 30532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:18:01.346436 30532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:01.346609 30532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:01.346711 30532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:18:01.346801 30532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:18:01.357613 30532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:01.359197 30532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:01.360575 30532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:01.373056 30541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:01.373219 30539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:01.373226 30543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:01.373991 30532 server_base.cc:1034] running on GCE node
I20260812 11:18:01.374938 30532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:01.376367 30532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:01.377599 30532 hybrid_clock.cc:648] HybridClock initialized: now 1786533481377543 us; error 30 us; skew 500 ppm
I20260812 11:18:01.378005 30532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:01 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:01.382289 30532 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:18:01.385167 30532 webserver.cc:460] Webserver started at http://127.15.164.254:44965/ using document root <none> and password file <none>
I20260812 11:18:01.386270 30532 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:01.386511 30532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:01.393453 30532 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 11:18:01.396543 30558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:01.398228 30532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:18:01.398454 30532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "9df0ae21e38c4fd2921e53018a2cbd10"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "d9030b0a3e6197f4c11642625fb75f8d"
server_key_iv: "85545f99097109364ae7c2296b3d8510"
server_key_version: "encryptionkey@0"
I20260812 11:18:01.399583 30532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:01.430436 30532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:01.435480 30532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:01.435807 30532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:01.456656 30532 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41211
I20260812 11:18:01.456686 30649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41211 every 8 connection(s)
I20260812 11:18:01.458382 30532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:18:01.464061 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 30532
I20260812 11:18:01.465101 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:36995
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:41211
--webserver_port=36099
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:18:01.466642 30652 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:18:01.472100 30652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Bootstrap starting.
I20260812 11:18:01.493036 30652 log.cc:824] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:01.502664 30652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:18:01.503366 30652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Bootstrap complete.
I20260812 11:18:01.513233 30652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:18:01.514084 30652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9df0ae21e38c4fd2921e53018a2cbd10, State: Initialized, Role: FOLLOWER
I20260812 11:18:01.514850 30652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:18:01.515120 30652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:18:01.515368 30652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:18:01.515690 30652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:18:01.519923 30652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:18:01.520691 30652 leader_election.cc:302] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9df0ae21e38c4fd2921e53018a2cbd10; no voters:
I20260812 11:18:01.521430 30652 leader_election.cc:288] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:18:01.521574 30657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:18:01.523160 30657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [term 2 LEADER]: Becoming Leader. State: Replica: 9df0ae21e38c4fd2921e53018a2cbd10, State: Running, Role: LEADER
I20260812 11:18:01.523849 30657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } }
I20260812 11:18:01.524096 30652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:18:01.526825 30659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9df0ae21e38c4fd2921e53018a2cbd10. Latest consensus state: current_term: 2 leader_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } } }
I20260812 11:18:01.526988 30658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df0ae21e38c4fd2921e53018a2cbd10" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41211 } } }
I20260812 11:18:01.527390 30658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:01.527387 30659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10 [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:01.528445 30666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:18:01.548018 30666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:18:01.550024 30666 catalog_manager.cc:1259] Loaded cluster ID: 985adf1138d04642b1603963d012e430
I20260812 11:18:01.550292 30666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:18:01.555632 30666 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:18:01.557760 30666 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9df0ae21e38c4fd2921e53018a2cbd10: Loaded TSK: 0
I20260812 11:18:01.559788 30666 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:18:01.874599 30654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:01.874956 30654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:01.875123 30654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:01.882866 30654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:01.882997 30654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:01.883167 30654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:18:01.893579 30654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.193.keytab
--principal=oryx/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:36995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=36099
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:01.895169 30654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:01.896546 30654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:01.913763 30694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:01.914119 30697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:01.914896 30691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:01.915750 30654 server_base.cc:1034] running on GCE node
I20260812 11:18:01.916589 30654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:01.917728 30654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:01.919003 30654 hybrid_clock.cc:648] HybridClock initialized: now 1786533481918916 us; error 83 us; skew 500 ppm
I20260812 11:18:01.919417 30654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:01 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533481, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:01.923147 30654 init.cc:377] Logged in from keytab as oryx/127.15.164.193@KRBTEST.COM (short username oryx)
I20260812 11:18:01.925048 30654 webserver.cc:460] Webserver started at http://127.15.164.193:36099/ using document root <none> and password file <none>
I20260812 11:18:01.925845 30654 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:01.926009 30654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:01.932412 30654 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:18:01.935390 30709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:01.936892 30654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:18:01.937077 30654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "085d436a87d64faea26fab951595d6e9"
format_stamp: "Formatted at 2026-08-12 11:17:58 on dist-test-slave-7kzw"
server_key: "36f41c1550473fe58b5ed68795e3309a"
server_key_iv: "a9ce7b688cf953004d422ca4f29e1a77"
server_key_version: "encryptionkey@0"
I20260812 11:18:01.938076 30654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:01.960294 30654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:01.965093 30654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:01.965418 30654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:01.966639 30654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:01.968222 30654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:01.968314 30654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:01.968474 30654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:01.968573 30654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.004176 30654 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:36995
I20260812 11:18:02.004311 30900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:36995 every 8 connection(s)
I20260812 11:18:02.005736 30654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:18:02.007989 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 30654
I20260812 11:18:02.008816 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:46075
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:41211
--webserver_port=37509
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:02.027546 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.009494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:39699)
0812 11:18:02.010445 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.010520 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.012863 (+ 2343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.014363 (+ 1500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.014377 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.015277 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.016218 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.016238 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.017937 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.017943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.019682 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.019703 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.020998 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.021004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.021202 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.021949 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.021981 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.026437 (+ 4456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":359,"threads_started":1}
W20260812 11:18:02.028328 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.009515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:39699 (local address 127.15.164.254:41211)
0812 11:18:02.011472 (+ 1957us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.011487 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.011542 (+ 55us) server_negotiation.cc:407] Connection header received
0812 11:18:02.013468 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.013481 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.013829 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.014203 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.016473 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.017757 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.019866 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.020734 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.020988 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.026988 (+ 6000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:39699: BlockingRecv error: recv got EOF from 127.15.164.193:39699 (error 108)
Metrics: {"server-negotiator.queue_time_us":1680,"thread_start_us":1451,"threads_started":1}
W20260812 11:18:02.028893 30901 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.164.254:41211: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:02.040308 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.029572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:35895)
0812 11:18:02.029804 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.029829 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.029969 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.030443 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.030451 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.030988 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.031220 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.031237 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.032701 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.032710 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.034517 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.034539 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.035309 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.035318 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.035552 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.036294 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.036326 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.040077 (+ 3751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:18:02.040735 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.029738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35895 (local address 127.15.164.254:41211)
0812 11:18:02.029905 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.029909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.029930 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:18:02.030208 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.030212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.030280 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.030369 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.031422 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.032527 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.034711 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.035120 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.035234 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.040432 (+ 5198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:35895: BlockingRecv error: recv got EOF from 127.15.164.193:35895 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:02.050563 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.041203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:60867)
0812 11:18:02.041457 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.041482 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.041619 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.042143 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.042147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.042603 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.042838 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.042848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.043942 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.043948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.044856 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.044867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.045576 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.045582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.045770 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.046444 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.046554 (+ 110us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.050211 (+ 3657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 11:18:02.050951 30901 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:18:02.051095 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.041396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:60867 (local address 127.15.164.254:41211)
0812 11:18:02.041590 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.041597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.041618 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:18:02.041793 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.041798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.041934 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.042084 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.042980 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.043793 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.045001 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.045419 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.045553 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.050461 (+ 4908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:60867: BlockingRecv error: recv got EOF from 127.15.164.193:60867 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 11:18:02.379825 30907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:02.380133 30907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:02.380293 30907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:02.387884 30907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:02.388020 30907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:02.388203 30907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:18:02.398726 30907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.194.keytab
--principal=oryx/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:46075
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=37509
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:02.400259 30907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:02.401772 30907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:02.417618 30918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:02.417730 30914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:02.417744 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:02.424129 30907 server_base.cc:1034] running on GCE node
I20260812 11:18:02.424968 30907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:02.426204 30907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:02.427470 30907 hybrid_clock.cc:648] HybridClock initialized: now 1786533482427412 us; error 104 us; skew 500 ppm
I20260812 11:18:02.427862 30907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533482, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:02.431751 30907 init.cc:377] Logged in from keytab as oryx/127.15.164.194@KRBTEST.COM (short username oryx)
I20260812 11:18:02.433581 30907 webserver.cc:460] Webserver started at http://127.15.164.194:37509/ using document root <none> and password file <none>
I20260812 11:18:02.434717 30907 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:02.434926 30907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:02.442036 30907 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 11:18:02.445508 30925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.447423 30907 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:18:02.447669 30907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "895afd07632d41abb7d18567e7be3b5c"
format_stamp: "Formatted at 2026-08-12 11:17:59 on dist-test-slave-7kzw"
server_key: "a1aef97d61f5eb8d05ffb50ec0df0f89"
server_key_iv: "4f4c57d74a5ad3912dc3b356540a6a24"
server_key_version: "encryptionkey@0"
I20260812 11:18:02.448828 30907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:02.474306 30907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:02.479177 30907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:02.479507 30907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:02.480643 30907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:02.482276 30907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:02.482415 30907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.482591 30907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:02.482702 30907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.521550 30907 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46075
I20260812 11:18:02.521654 31120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46075 every 8 connection(s)
I20260812 11:18:02.523149 30907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:18:02.523759 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 30907
I20260812 11:18:02.524760 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:45269
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:41211
--webserver_port=39827
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:18:02.541356 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.526395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:59189 (local address 127.15.164.254:41211)
0812 11:18:02.526641 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.526647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.528215 (+ 1568us) server_negotiation.cc:407] Connection header received
0812 11:18:02.530165 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.530171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.530275 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.530394 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.532039 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.532825 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.534486 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.535143 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.535300 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.541001 (+ 5701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:59189: BlockingRecv error: recv got EOF from 127.15.164.194:59189 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 11:18:02.542012 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.527054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:59189)
0812 11:18:02.528014 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.528058 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.529875 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.530684 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.530694 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.531241 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.531835 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.531854 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.533014 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.533018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.534300 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.534314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.535599 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.535614 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.535996 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.536835 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.536870 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.540720 (+ 3850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":432,"threads_started":1}
W20260812 11:18:02.543124 31121 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.164.254:41211: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:02.553316 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.544019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:58901)
0812 11:18:02.544228 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.544254 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.544374 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.544715 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.544718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.545047 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.545193 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.545201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.546839 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.546844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.547923 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.547938 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.549110 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.549115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.549281 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.549963 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.549983 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.553035 (+ 3052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:18:02.553707 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.544112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:58901 (local address 127.15.164.254:41211)
0812 11:18:02.544345 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.544353 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.544379 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:18:02.544473 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.544480 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.544569 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.544684 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.545350 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.546642 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.548086 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.548927 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.549087 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.553400 (+ 4313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:58901: BlockingRecv error: recv got EOF from 127.15.164.194:58901 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:02.562991 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:02.554216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:34501)
0812 11:18:02.554469 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:02.554508 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:02.554610 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:02.554951 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:02.554955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:02.555260 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:02.555414 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.555422 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.556955 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.556959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.557903 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:02.557916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.558977 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.558982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:02.559154 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.559864 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:02.559882 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:02.562771 (+ 2889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140}
W20260812 11:18:02.563361 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:02.554381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:34501 (local address 127.15.164.254:41211)
0812 11:18:02.554600 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:02.554608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:02.554632 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:18:02.554693 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:02.554701 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:02.554806 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:02.554926 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:02.555561 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.556805 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.558143 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:02.558806 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:02.558934 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:02.563034 (+ 4100us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:34501: BlockingRecv error: recv got EOF from 127.15.164.194:34501 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 11:18:02.563529 31121 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:18:02.895681 31125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:02.895987 31125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:02.896174 31125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:02.903954 31125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:02.904129 31125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:02.904269 31125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:18:02.916055 31125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/krb5kdc/oryx_127.15.164.195.keytab
--principal=oryx/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:45269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=39827
--tserver_master_addrs=127.15.164.254:41211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:02.917564 31125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:02.919472 31125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:02.934540 31134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:02.934435 31136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:02.934520 31138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:02.935791 31125 server_base.cc:1034] running on GCE node
I20260812 11:18:02.936470 31125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:02.937510 31125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:02.938828 31125 hybrid_clock.cc:648] HybridClock initialized: now 1786533482938780 us; error 58 us; skew 500 ppm
I20260812 11:18:02.939224 31125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:02 dist-test-slave-7kzw krb5kdc[29656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533482, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:02.943090 31125 init.cc:377] Logged in from keytab as oryx/127.15.164.195@KRBTEST.COM (short username oryx)
I20260812 11:18:02.945271 31125 webserver.cc:460] Webserver started at http://127.15.164.195:39827/ using document root <none> and password file <none>
I20260812 11:18:02.946059 31125 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:02.946237 31125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:02.952190 31125 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 11:18:02.955506 31150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.957232 31125 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:18:02.957459 31125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "71ebf7f5491e4eac9096155d9d831752"
format_stamp: "Formatted at 2026-08-12 11:18:00 on dist-test-slave-7kzw"
server_key: "ee3fa24f04e727915ee70c37d30175c3"
server_key_iv: "be51753855fb2aed608a087efc1df40b"
server_key_version: "encryptionkey@0"
I20260812 11:18:02.958636 31125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:02.979084 31125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:02.984022 31125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:02.984352 31125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:02.985538 31125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:02.987075 31125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:02.987221 31125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:02.987394 31125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:02.987496 31125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:03.030354 31125 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:45269
I20260812 11:18:03.030403 31338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:45269 every 8 connection(s)
I20260812 11:18:03.032020 31125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:18:03.038730 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 31125
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:18:03.051728 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:03.035281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:56615 (local address 127.15.164.254:41211)
0812 11:18:03.035498 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.035503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.036794 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 11:18:03.038812 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.038818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.038921 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.039039 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.041284 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.042147 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.044429 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.044838 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.044970 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.051384 (+ 6414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:56615: BlockingRecv error: recv got EOF from 127.15.164.195:56615 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:18:03.052742 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.035837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:56615)
0812 11:18:03.036620 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:03.036660 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:03.038515 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:03.039306 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:03.039315 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:03.040188 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:03.041075 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.041118 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.042309 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.042314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.044280 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.044293 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.045087 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.045107 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.045426 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.046327 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:03.046355 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:03.051126 (+ 4771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":319,"threads_started":1}
W20260812 11:18:03.053495 31339 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.164.254:41211: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
I20260812 11:18:03.057714 31345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.039910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48740 (local address 127.15.164.254:41211)
0812 11:18:03.040680 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.040686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.040705 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:18:03.040752 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.040757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.040840 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.040960 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.042634 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.043815 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.045221 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.045842 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.045974 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.048818 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:03.048827 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:03.048847 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:03.048890 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:03.052822 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:03.054071 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:03.054080 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:03.054088 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:03.054298 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:03.054929 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:03.054938 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:03.054943 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:03.055502 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:03.055904 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:03.057129 (+ 1225us) server_negotiation.cc:299] Negotiation successful
0812 11:18:03.057408 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":627,"thread_start_us":463,"threads_started":1}
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:03.064965 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.051581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:52949)
0812 11:18:03.052958 (+ 1377us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:03.052984 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:03.053147 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:03.053822 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:03.053828 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:03.054517 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:03.054848 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.054869 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.056426 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.056432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.058182 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.058198 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.059366 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.059373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.059545 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.060534 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:03.060552 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:03.064549 (+ 3997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1241,"thread_start_us":1031,"threads_started":1}
W20260812 11:18:03.065141 30906 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:03.052096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:52949 (local address 127.15.164.254:41211)
0812 11:18:03.052442 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.052449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.053086 (+ 637us) server_negotiation.cc:407] Connection header received
0812 11:18:03.053325 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.053330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.053422 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.053500 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.055060 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.056220 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.058334 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.058970 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.059090 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.064848 (+ 5758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:52949: BlockingRecv error: recv got EOF from 127.15.164.193:52949 (error 108)
Metrics: {"server-negotiator.queue_time_us":223}
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:03.066377 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.054190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:34003)
0812 11:18:03.054397 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:03.054419 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:03.054557 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:03.055658 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:03.055663 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:03.056084 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:03.056286 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.056297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.058589 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.058602 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.059981 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.059994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.060961 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.060967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.061207 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.062029 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:03.062064 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:03.066067 (+ 4003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:18:03.066761 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:03.054541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:34003 (local address 127.15.164.254:41211)
0812 11:18:03.055317 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.055324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.055342 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:18:03.055389 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.055394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.055476 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.055593 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.056441 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.058434 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.060166 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.060805 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.060941 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.066364 (+ 5423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:34003: BlockingRecv error: recv got EOF from 127.15.164.195:34003 (error 108)
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":332,"threads_started":1}
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:03.076166 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.067297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:55865)
0812 11:18:03.067495 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:03.067524 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:03.067612 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:03.067901 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:03.067904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:03.068231 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:03.068389 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.068398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.069451 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.069455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.070531 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.070552 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.071293 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.071298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.071462 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.072140 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:03.072161 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:03.075929 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:18:03.076506 31339 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:18:03.076534 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:03.067380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:55865 (local address 127.15.164.254:41211)
0812 11:18:03.067575 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.067579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.067596 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:18:03.067714 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.067718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.067775 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.067854 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.068546 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.069287 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.070737 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.071134 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.071245 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.076205 (+ 4960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:55865: BlockingRecv error: recv got EOF from 127.15.164.195:55865 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:03 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:03.578359 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:03.564150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:58663)
0812 11:18:03.564802 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:03.564820 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:03.564991 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:03.565389 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:03.565395 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:03.566039 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:03.566243 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.566254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.567475 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.567481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.568473 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:03.568485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.569242 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.569249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:03.569431 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.574546 (+ 5115us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:03.574573 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:03.577976 (+ 3403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":368,"threads_started":1}
W20260812 11:18:03.578569 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:03.564312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:58663 (local address 127.15.164.254:41211)
0812 11:18:03.564546 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:03.564603 (+ 57us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:03.564930 (+ 327us) server_negotiation.cc:407] Connection header received
0812 11:18:03.565149 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:03.565154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:03.565239 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:03.565354 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:03.566424 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.567323 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.568631 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:03.569045 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:03.569188 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:03.578248 (+ 9060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:58663: BlockingRecv error: recv got EOF from 127.15.164.194:58663 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:04.075709 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:04.066374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:49565)
0812 11:18:04.067040 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:04.067057 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:04.067233 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:04.067686 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:04.067693 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:04.068156 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:04.068332 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.068342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.069382 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.069389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.070298 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.070310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.071113 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.071119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.071298 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.071976 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:04.071997 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:04.075352 (+ 3355us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":434,"threads_started":1}
W20260812 11:18:04.075820 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:04.066506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:49565 (local address 127.15.164.254:41211)
0812 11:18:04.066759 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:04.066767 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:04.067158 (+ 391us) server_negotiation.cc:407] Connection header received
0812 11:18:04.067380 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:04.067387 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:04.067507 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:04.067630 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:04.068489 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.069228 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.070447 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.070937 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.071076 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.075581 (+ 4505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:49565: BlockingRecv error: recv got EOF from 127.15.164.193:49565 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:04.086946 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:04.077128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:36631)
0812 11:18:04.077748 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:04.077766 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:04.077890 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:04.078241 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:04.078245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:04.078960 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:04.079192 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.079202 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.080294 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.080301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.081957 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.081973 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.082868 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.082874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.083011 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.083636 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:04.083662 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:04.086696 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":311,"threads_started":1}
W20260812 11:18:04.087282 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:04.077199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:36631 (local address 127.15.164.254:41211)
0812 11:18:04.077359 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:04.077364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:04.077851 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:18:04.077995 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:04.077999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:04.078062 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:04.078147 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:04.079337 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.080110 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.082164 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.082629 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.082753 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.086902 (+ 4149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:36631: BlockingRecv error: recv got EOF from 127.15.164.195:36631 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:04 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:04.589594 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:04.579616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:60959)
0812 11:18:04.580224 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:04.580241 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:04.580376 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:04.581066 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:04.581071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:04.581636 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:04.581845 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.581857 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.583155 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.583160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.584247 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:04.584262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.585096 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.585101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:04.585225 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.585935 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:04.585954 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:04.589334 (+ 3380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":347,"threads_started":1}
W20260812 11:18:04.590003 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:04.579662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:60959 (local address 127.15.164.254:41211)
0812 11:18:04.579864 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:04.579869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:04.580342 (+ 473us) server_negotiation.cc:407] Connection header received
0812 11:18:04.580487 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:04.580492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:04.580660 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:04.580771 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:04.582052 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.582989 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.584431 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:04.584923 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:04.585042 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:04.589687 (+ 4645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:60959: BlockingRecv error: recv got EOF from 127.15.164.194:60959 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:18:05.089993 31347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:05.077323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:45137 (local address 127.15.164.254:41211)
0812 11:18:05.077518 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:05.077522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:05.078168 (+ 646us) server_negotiation.cc:407] Connection header received
0812 11:18:05.078542 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:05.078547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:05.078629 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:05.078739 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:05.079974 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.081227 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.083645 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.084460 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.084627 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.089711 (+ 5084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:45137: BlockingRecv error: recv got EOF from 127.15.164.193:45137 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:18:05.089851 31357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:05.076850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:45137)
0812 11:18:05.078025 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:05.078065 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:05.078321 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:05.078814 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:05.078822 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:05.079451 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:05.079746 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.079766 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.081445 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.081454 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.083449 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.083474 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.084662 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.084671 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.084933 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.085666 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:05.085702 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:05.089439 (+ 3737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":995,"thread_start_us":657,"threads_started":1}
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:05.103860 31358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:05.087930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:33963)
0812 11:18:05.094778 (+ 6848us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:05.094798 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:05.094985 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:05.095370 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:05.095375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:05.095831 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:05.096013 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.096024 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.097164 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.097182 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.098153 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.098165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.099245 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.099254 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.099413 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.099996 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:05.100017 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:05.103526 (+ 3509us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6739,"thread_start_us":6621,"threads_started":1}
W20260812 11:18:05.104302 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:05.088025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:33963 (local address 127.15.164.254:41211)
0812 11:18:05.088680 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:05.088687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:05.094898 (+ 6211us) server_negotiation.cc:407] Connection header received
0812 11:18:05.095124 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:05.095130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:05.095210 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:05.095334 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:05.096179 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.097005 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.098330 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.098872 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.098947 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.103882 (+ 4935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:33963: BlockingRecv error: recv got EOF from 127.15.164.195:33963 (error 108)
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":312,"threads_started":1}
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:05 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:05.600957 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:05.590905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:44779)
0812 11:18:05.591472 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:05.591490 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:05.591675 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:05.592068 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:05.592073 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:05.592517 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:05.592711 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.592721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.593917 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.593923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.595022 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:05.595036 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.595827 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.595835 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:05.596055 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.596788 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:05.596810 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:05.600689 (+ 3879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":300,"threads_started":1}
W20260812 11:18:05.601325 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:05.591007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:44779 (local address 127.15.164.254:41211)
0812 11:18:05.591300 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:05.591309 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:05.591587 (+ 278us) server_negotiation.cc:407] Connection header received
0812 11:18:05.591827 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:05.591833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:05.591918 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:05.592032 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:05.592890 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.593756 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.595182 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:05.595650 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:05.595796 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:05.601025 (+ 5229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:44779: BlockingRecv error: recv got EOF from 127.15.164.194:44779 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:06.100947 31361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:06.091393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:53473)
0812 11:18:06.092005 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:06.092022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:06.092218 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:06.092610 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:06.092614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:06.093100 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:06.093286 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.093296 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.094362 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.094370 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.095466 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.095481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.096584 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.096591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.096798 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.097539 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:06.097560 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:06.100706 (+ 3146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":363,"threads_started":1}
W20260812 11:18:06.101272 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:06.091594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53473 (local address 127.15.164.254:41211)
0812 11:18:06.091880 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:06.091887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:06.092115 (+ 228us) server_negotiation.cc:407] Connection header received
0812 11:18:06.092361 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:06.092374 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:06.092453 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:06.092572 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:06.093442 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.094214 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.095691 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.096405 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.096576 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.100945 (+ 4369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:53473: BlockingRecv error: recv got EOF from 127.15.164.193:53473 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:06.115154 31362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:06.104976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:56435)
0812 11:18:06.105575 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:06.105593 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:06.105773 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:06.106207 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:06.106212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:06.106739 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:06.106926 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.106936 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.108107 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.108115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.109432 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.109450 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.110284 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.110289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.110521 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.111336 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:06.111359 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:06.114842 (+ 3483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":343,"threads_started":1}
W20260812 11:18:06.115394 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:06.105022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:56435 (local address 127.15.164.254:41211)
0812 11:18:06.105306 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:06.105317 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:06.105697 (+ 380us) server_negotiation.cc:407] Connection header received
0812 11:18:06.105917 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:06.105923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:06.106014 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:06.106175 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:06.107100 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.107890 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.109634 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.110130 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.110245 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.115135 (+ 4890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:56435: BlockingRecv error: recv got EOF from 127.15.164.195:56435 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:06 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:06.612233 31363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:06.602213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:54293)
0812 11:18:06.603328 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:06.603346 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:06.603513 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:06.603951 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:06.603960 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:06.604469 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:06.604635 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.604644 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.605836 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.605841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.606813 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:06.606825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.607623 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.607629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:06.607785 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.608550 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:06.608571 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:06.611987 (+ 3416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":971,"thread_start_us":843,"threads_started":1}
W20260812 11:18:06.612639 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:06.602413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:54293 (local address 127.15.164.254:41211)
0812 11:18:06.602677 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:06.602687 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:06.603444 (+ 757us) server_negotiation.cc:407] Connection header received
0812 11:18:06.603681 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:06.603687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:06.603771 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:06.603866 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:06.604879 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.605694 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.606958 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:06.607439 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:06.607547 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:06.612275 (+ 4728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:54293: BlockingRecv error: recv got EOF from 127.15.164.194:54293 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:07.111552 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:07.102146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:57967)
0812 11:18:07.102712 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:07.102754 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:07.102911 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:07.103457 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:07.103461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:07.104090 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:07.104330 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.104347 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.105467 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.105471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.106681 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.106695 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.107432 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.107437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.107564 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.108238 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:07.108257 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:07.111276 (+ 3019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":244,"threads_started":1}
W20260812 11:18:07.111881 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:07.102416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:57967 (local address 127.15.164.254:41211)
0812 11:18:07.102673 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:07.102680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:07.102874 (+ 194us) server_negotiation.cc:407] Connection header received
0812 11:18:07.103097 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:07.103102 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:07.103243 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:07.103386 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:07.104518 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.105322 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.106828 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.107292 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.107417 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.111548 (+ 4131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:57967: BlockingRecv error: recv got EOF from 127.15.164.193:57967 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:07.126394 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:07.116236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:38163)
0812 11:18:07.116820 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:07.116843 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:07.117010 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:07.117453 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:07.117462 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:07.118124 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:07.118339 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.118354 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.119672 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.119677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.120657 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.120671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.121451 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.121456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.121590 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.122248 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:07.122268 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:07.126123 (+ 3855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":332,"threads_started":1}
W20260812 11:18:07.126883 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:07.116330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:38163 (local address 127.15.164.254:41211)
0812 11:18:07.116684 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:07.116691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:07.116952 (+ 261us) server_negotiation.cc:407] Connection header received
0812 11:18:07.117194 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:07.117201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:07.117283 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:07.117411 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:07.118550 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.119517 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.120810 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.121259 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.121359 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.126432 (+ 5073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:38163: BlockingRecv error: recv got EOF from 127.15.164.195:38163 (error 108)
Metrics: {"server-negotiator.queue_time_us":189}
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:07 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:07.622033 31367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:07.613222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:33741)
0812 11:18:07.613895 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:07.613911 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:07.614076 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:07.614452 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:07.614457 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:07.614947 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:07.615118 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.615128 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.616157 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.616162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.617068 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:07.617079 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.617823 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.617829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:07.618008 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.618716 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:07.618734 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:07.621659 (+ 2925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":350,"threads_started":1}
W20260812 11:18:07.622102 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:07.613451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:33741 (local address 127.15.164.254:41211)
0812 11:18:07.613718 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:07.613727 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:07.614000 (+ 273us) server_negotiation.cc:407] Connection header received
0812 11:18:07.614231 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:07.614242 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:07.614306 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:07.614414 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:07.615275 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.616000 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.617225 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:07.617671 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:07.617809 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:07.621871 (+ 4062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:33741: BlockingRecv error: recv got EOF from 127.15.164.194:33741 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:08.121937 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:08.112681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:54475)
0812 11:18:08.113235 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:08.113252 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:08.113376 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:08.113810 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:08.113813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:08.114221 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:08.114387 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.114397 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.115600 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.115605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.116510 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.116521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.117291 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.117296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.117420 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.118111 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:08.118131 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:08.121685 (+ 3554us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":324,"threads_started":1}
W20260812 11:18:08.122303 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:08.112861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:54475 (local address 127.15.164.254:41211)
0812 11:18:08.113158 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:08.113166 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:08.113351 (+ 185us) server_negotiation.cc:407] Connection header received
0812 11:18:08.113488 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:08.113492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:08.113562 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:08.113662 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:08.114592 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.115449 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.116668 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.117127 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.117237 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.121931 (+ 4694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:54475: BlockingRecv error: recv got EOF from 127.15.164.193:54475 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:08.137168 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:08.127626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:35951)
0812 11:18:08.128224 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:08.128241 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:08.128403 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:08.128762 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:08.128767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:08.129211 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:08.129405 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.129419 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.130579 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.130583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.131530 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.131569 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.132468 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.132474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.132677 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.133542 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:08.133560 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:08.136742 (+ 3182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":291,"threads_started":1}
W20260812 11:18:08.137274 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:08.127778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:35951 (local address 127.15.164.254:41211)
0812 11:18:08.128011 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:08.128018 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:08.128329 (+ 311us) server_negotiation.cc:407] Connection header received
0812 11:18:08.128546 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:08.128550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:08.128624 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:08.128729 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:08.129605 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.130368 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.131733 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.132294 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.132441 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.137005 (+ 4564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:35951: BlockingRecv error: recv got EOF from 127.15.164.195:35951 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:08 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:08.639501 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:08.623335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:43923)
0812 11:18:08.623976 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:08.624018 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:08.624219 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:08.624753 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:08.624761 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:08.625307 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:08.625541 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.625555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.626998 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.627003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.627973 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:08.627986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.628845 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.628850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:08.628974 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.635510 (+ 6536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:08.635535 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:08.639264 (+ 3729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":359,"threads_started":1}
W20260812 11:18:08.639952 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:08.623448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:43923 (local address 127.15.164.254:41211)
0812 11:18:08.623715 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:08.623724 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:08.624173 (+ 449us) server_negotiation.cc:407] Connection header received
0812 11:18:08.624428 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:08.624438 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:08.624531 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:08.624650 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:08.625757 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.626837 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.628157 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:08.628643 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:08.628786 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:08.639571 (+ 10785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:43923: BlockingRecv error: recv got EOF from 127.15.164.194:43923 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:09.133805 31371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:09.122961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:37591)
0812 11:18:09.123651 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:09.123669 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:09.123795 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:09.124207 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:09.124211 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:09.124773 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:09.124970 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.124982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.126700 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.126708 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.128280 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.128302 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.129096 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.129102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.129252 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.129910 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:09.129932 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:09.133526 (+ 3594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":369,"threads_started":1}
W20260812 11:18:09.134079 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:09.123215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:37591 (local address 127.15.164.254:41211)
0812 11:18:09.123410 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:09.123415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:09.123792 (+ 377us) server_negotiation.cc:407] Connection header received
0812 11:18:09.123916 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:09.123921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:09.123997 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:09.124098 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:09.125134 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.126435 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.128453 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.128912 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.129018 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.133822 (+ 4804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:37591: BlockingRecv error: recv got EOF from 127.15.164.193:37591 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:09.147727 31373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:09.138557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:33085)
0812 11:18:09.139182 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:09.139200 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:09.139390 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:09.139805 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:09.139810 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:09.140323 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:09.140530 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.140540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.141798 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.141804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.142824 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.142837 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.143593 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.143599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.143781 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.144439 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:09.144457 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:09.147393 (+ 2936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":350,"threads_started":1}
W20260812 11:18:09.147910 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:09.138757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:33085 (local address 127.15.164.254:41211)
0812 11:18:09.138997 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:09.139004 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:09.139331 (+ 327us) server_negotiation.cc:407] Connection header received
0812 11:18:09.139539 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:09.139544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:09.139628 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:09.139746 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:09.140680 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.141646 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.142970 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.143425 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.143568 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.147624 (+ 4056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:33085: BlockingRecv error: recv got EOF from 127.15.164.195:33085 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:09 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:09.650552 31375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:09.640499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:48105)
0812 11:18:09.641085 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:09.641102 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:09.641242 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:09.641560 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:09.641563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:09.642144 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:09.642341 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.642352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.643533 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.643537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.644467 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:09.644481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.645286 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.645292 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:09.645411 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.646219 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:09.646271 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:09.650212 (+ 3941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":282,"threads_started":1}
W20260812 11:18:09.650758 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:09.640609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:48105 (local address 127.15.164.254:41211)
0812 11:18:09.640893 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:09.640902 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:09.641192 (+ 290us) server_negotiation.cc:407] Connection header received
0812 11:18:09.641354 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:09.641358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:09.641426 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:09.641517 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:09.642578 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.643380 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.644641 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:09.645118 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:09.645237 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:09.650432 (+ 5195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:48105: BlockingRecv error: recv got EOF from 127.15.164.194:48105 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:10.145328 31379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:10.135179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:54447)
0812 11:18:10.135884 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:10.135903 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:10.136121 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:10.136621 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:10.136627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:10.137239 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:10.137475 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.137488 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.138762 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.138767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.139773 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.139786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.140713 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.140718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.140851 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.141521 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:10.141541 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:10.145066 (+ 3525us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":399,"threads_started":1}
W20260812 11:18:10.145655 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:10.135497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:54447 (local address 127.15.164.254:41211)
0812 11:18:10.135702 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:10.135707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:10.136121 (+ 414us) server_negotiation.cc:407] Connection header received
0812 11:18:10.136317 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:10.136323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:10.136411 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:10.136529 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:10.137654 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.138601 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.139943 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.140483 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.140618 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.145322 (+ 4704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:54447: BlockingRecv error: recv got EOF from 127.15.164.193:54447 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:10.158457 31380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:10.148875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:39255)
0812 11:18:10.149528 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:10.149550 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:10.149699 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:10.150124 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:10.150131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:10.150717 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:10.150965 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.150977 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.152081 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.152086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.153125 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.153140 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.154125 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.154129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.154271 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.155010 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:10.155029 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:10.158194 (+ 3165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":320,"threads_started":1}
W20260812 11:18:10.158985 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:10.149072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:39255 (local address 127.15.164.254:41211)
0812 11:18:10.149270 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:10.149275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:10.149644 (+ 369us) server_negotiation.cc:407] Connection header received
0812 11:18:10.149821 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:10.149826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:10.149918 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:10.149999 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:10.151148 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.151896 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.153333 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.153961 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.154079 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.158528 (+ 4449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:39255: BlockingRecv error: recv got EOF from 127.15.164.195:39255 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:10 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:10.663141 31383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:10.651749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:44011)
0812 11:18:10.652333 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:10.652359 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:10.652528 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:10.652891 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:10.652915 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:10.653491 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:10.653648 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.653666 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.655025 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.655037 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.656218 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:10.656234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.657400 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.657408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:10.657605 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.658441 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:10.658499 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:10.662772 (+ 4273us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":304,"threads_started":1}
W20260812 11:18:10.663333 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:10.651856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:44011 (local address 127.15.164.254:41211)
0812 11:18:10.652130 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:10.652138 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:10.652452 (+ 314us) server_negotiation.cc:407] Connection header received
0812 11:18:10.652676 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:10.652681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:10.652748 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:10.652858 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:10.653812 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.654877 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.656405 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:10.657177 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:10.657368 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:10.663049 (+ 5681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:44011: BlockingRecv error: recv got EOF from 127.15.164.194:44011 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:11.155671 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:11.146611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:43691)
0812 11:18:11.147252 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:11.147288 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:11.147431 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:11.147828 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:11.147832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:11.148408 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:11.148590 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.148601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.149654 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.149658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.150731 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.150744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.151455 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.151460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.151579 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.152203 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:11.152222 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:11.155413 (+ 3191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":343,"threads_started":1}
W20260812 11:18:11.155998 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:11.146659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:43691 (local address 127.15.164.254:41211)
0812 11:18:11.146933 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:11.146944 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:11.147395 (+ 451us) server_negotiation.cc:407] Connection header received
0812 11:18:11.147532 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:11.147537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:11.147624 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:11.147721 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:11.148770 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.149516 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.150889 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.151313 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.151418 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.155694 (+ 4276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:43691: BlockingRecv error: recv got EOF from 127.15.164.193:43691 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:11.168816 31385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:11.159648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:37045)
0812 11:18:11.160263 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:11.160280 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:11.160439 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:11.160920 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:11.160924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:11.161296 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:11.161497 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.161517 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.162749 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.162754 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.163926 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.163940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.164720 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.164726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.164847 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.165427 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:11.165445 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:11.168443 (+ 2998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":327,"threads_started":1}
W20260812 11:18:11.168939 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:11.159701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:37045 (local address 127.15.164.254:41211)
0812 11:18:11.159906 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:11.159912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:11.160357 (+ 445us) server_negotiation.cc:407] Connection header received
0812 11:18:11.160665 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:11.160672 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:11.160764 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:11.160891 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:11.161661 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.162555 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.164064 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.164503 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.164603 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.168677 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:37045: BlockingRecv error: recv got EOF from 127.15.164.195:37045 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:11 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:11.675719 31386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:11.664381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:52161)
0812 11:18:11.665186 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:11.665212 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:11.665380 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:11.665856 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:11.665861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:11.666422 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:11.666690 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.666707 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.668060 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.668066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.669618 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:11.669635 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.671436 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.671443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:11.671592 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.672265 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:11.672285 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:11.675434 (+ 3149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":532,"threads_started":1}
W20260812 11:18:11.675930 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:11.664484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:52161 (local address 127.15.164.254:41211)
0812 11:18:11.664738 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:11.664749 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:11.665314 (+ 565us) server_negotiation.cc:407] Connection header received
0812 11:18:11.665528 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:11.665533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:11.665684 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:11.665792 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:11.666848 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.667902 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.670192 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:11.671062 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:11.671189 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:11.675701 (+ 4512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:52161: BlockingRecv error: recv got EOF from 127.15.164.194:52161 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:12.166342 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:12.156773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:40993)
0812 11:18:12.157333 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:12.157350 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:12.157468 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:12.157857 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:12.157861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:12.158259 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:12.158418 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.158427 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.159691 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.159695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.160602 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.160612 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.161710 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.161716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.161834 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.162663 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:12.162689 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:12.166115 (+ 3426us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":314,"threads_started":1}
W20260812 11:18:12.166636 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:12.156899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:40993 (local address 127.15.164.254:41211)
0812 11:18:12.157103 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:12.157108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:12.157433 (+ 325us) server_negotiation.cc:407] Connection header received
0812 11:18:12.157636 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:12.157641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:12.157707 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:12.157795 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:12.158689 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.159507 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.160772 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.161507 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.161669 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.166334 (+ 4665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:40993: BlockingRecv error: recv got EOF from 127.15.164.193:40993 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:12.179464 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:12.169875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:52573)
0812 11:18:12.170399 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:12.170417 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:12.170660 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:12.170989 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:12.170992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:12.171396 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:12.171608 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.171619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.172742 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.172748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.173933 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.173950 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.175033 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.175039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.175180 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.175893 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:12.175914 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:12.179164 (+ 3250us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":280,"threads_started":1}
W20260812 11:18:12.179566 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:12.169958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:52573 (local address 127.15.164.254:41211)
0812 11:18:12.170204 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:12.170210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:12.170558 (+ 348us) server_negotiation.cc:407] Connection header received
0812 11:18:12.170784 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:12.170788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:12.170856 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:12.170941 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:12.171827 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.172572 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.174142 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.174871 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.174982 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.179368 (+ 4386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:52573: BlockingRecv error: recv got EOF from 127.15.164.195:52573 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:12 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:12.686559 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:12.677099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:53357)
0812 11:18:12.677731 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:12.677749 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:12.677921 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:12.678310 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:12.678316 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:12.678781 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:12.678938 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.678947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.680188 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.680195 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.681124 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:12.681136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.682178 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.682184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:12.682365 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.683133 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:12.683157 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:12.686197 (+ 3040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":320,"threads_started":1}
W20260812 11:18:12.686800 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:12.677235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:53357 (local address 127.15.164.254:41211)
0812 11:18:12.677512 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:12.677520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:12.677852 (+ 332us) server_negotiation.cc:407] Connection header received
0812 11:18:12.678059 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:12.678068 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:12.678165 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:12.678276 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:12.679211 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.680017 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.681285 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:12.681975 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:12.682131 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:12.686402 (+ 4271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:53357: BlockingRecv error: recv got EOF from 127.15.164.194:53357 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:13.176848 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:13.167431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:46565)
0812 11:18:13.168036 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:13.168054 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:13.168171 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:13.168606 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:13.168609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:13.169060 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:13.169262 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.169272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.170378 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.170382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.171459 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.171477 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.172362 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.172369 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.172553 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.173246 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:13.173265 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:13.176587 (+ 3322us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":343,"threads_started":1}
W20260812 11:18:13.177093 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:13.167685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:46565 (local address 127.15.164.254:41211)
0812 11:18:13.167929 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:13.167934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:13.168139 (+ 205us) server_negotiation.cc:407] Connection header received
0812 11:18:13.168362 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:13.168368 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:13.168440 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:13.168539 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:13.169468 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.170220 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.171627 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.172186 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.172326 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.176827 (+ 4501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:46565: BlockingRecv error: recv got EOF from 127.15.164.193:46565 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:13.189867 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:13.180559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:34139)
0812 11:18:13.181051 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:13.181068 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:13.181184 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:13.181514 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:13.181517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:13.181909 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:13.182055 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.182064 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.183460 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.183473 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.184899 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.184913 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.185900 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.185905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.186022 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.186722 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:13.186740 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:13.189631 (+ 2891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":291,"threads_started":1}
W20260812 11:18:13.190215 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:13.180606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:34139 (local address 127.15.164.254:41211)
0812 11:18:13.180834 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:13.180843 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:13.181155 (+ 312us) server_negotiation.cc:407] Connection header received
0812 11:18:13.181306 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:13.181310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:13.181387 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:13.181471 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:13.182190 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.183253 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.185067 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.185734 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.185847 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.189871 (+ 4024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:34139: BlockingRecv error: recv got EOF from 127.15.164.195:34139 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:13 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:13.703011 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:13.687840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:42919)
0812 11:18:13.688393 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:13.688409 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:13.688534 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:13.688854 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:13.688857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:13.689301 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:13.689478 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.689487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.690546 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.690554 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.691564 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:13.691580 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.692603 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.692610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:13.692798 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.699544 (+ 6746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:13.699565 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:13.702709 (+ 3144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":336,"threads_started":1}
W20260812 11:18:13.703311 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:13.687912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:42919 (local address 127.15.164.254:41211)
0812 11:18:13.688185 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:13.688195 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:13.688519 (+ 324us) server_negotiation.cc:407] Connection header received
0812 11:18:13.688650 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:13.688655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:13.688720 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:13.688808 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:13.689655 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.690359 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.691732 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:13.692429 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:13.692545 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:13.702999 (+ 10454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:42919: BlockingRecv error: recv got EOF from 127.15.164.194:42919 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:14.188117 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:14.178087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:60949)
0812 11:18:14.178809 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:14.178828 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:14.178964 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:14.179368 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:14.179372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:14.179883 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:14.180071 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.180083 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.181198 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.181203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.182286 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.182302 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.183195 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.183200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.183347 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.184093 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:14.184116 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:14.187737 (+ 3621us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":465,"threads_started":1}
W20260812 11:18:14.188246 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:14.178157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:60949 (local address 127.15.164.254:41211)
0812 11:18:14.178367 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:14.178372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:14.178936 (+ 564us) server_negotiation.cc:407] Connection header received
0812 11:18:14.179092 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:14.179096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:14.179178 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:14.179260 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:14.180247 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.181036 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.182459 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.183033 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.183149 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.187967 (+ 4818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:60949: BlockingRecv error: recv got EOF from 127.15.164.193:60949 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:14.200474 31397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:14.190990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:58729)
0812 11:18:14.191578 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:14.191597 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:14.191718 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:14.192109 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:14.192114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:14.192570 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:14.192769 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.192779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.193827 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.193832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.194956 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.194970 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.195734 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.195739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.195877 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.196508 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:14.196527 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:14.200235 (+ 3708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":324,"threads_started":1}
W20260812 11:18:14.200675 31359 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:14.191094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:58729 (local address 127.15.164.254:41211)
0812 11:18:14.191287 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:14.191292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:14.191705 (+ 413us) server_negotiation.cc:407] Connection header received
0812 11:18:14.191820 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:14.191824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:14.191923 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:14.192012 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:14.192925 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.193700 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.195124 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.195577 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.195699 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.200443 (+ 4744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:58729: BlockingRecv error: recv got EOF from 127.15.164.195:58729 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:14 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:14.713838 31398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:14.704060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:54983)
0812 11:18:14.704677 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:14.704703 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:14.704850 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:14.705239 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:14.705244 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:14.705714 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:14.705876 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.705885 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.707213 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.707220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.708256 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:14.708270 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.709141 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.709148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:14.709351 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.710114 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:14.710134 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:14.713449 (+ 3315us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":317,"threads_started":1}
W20260812 11:18:14.714080 31399 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:14.704118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:54983 (local address 127.15.164.254:41211)
0812 11:18:14.704789 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:14.704796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:14.704816 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:18:14.705005 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:14.705016 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:14.705086 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:14.705210 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:14.706036 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.707052 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.708427 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:14.708967 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:14.709127 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:14.713725 (+ 4598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:54983: BlockingRecv error: recv got EOF from 127.15.164.194:54983 (error 108)
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":358,"threads_started":1}
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:15.199034 31400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:15.189226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:54815)
0812 11:18:15.189806 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:15.189822 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:15.189938 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:15.190305 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:15.190310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:15.190809 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:15.191021 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.191032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.192232 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.192236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.193335 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.193350 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.194195 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.194204 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.194353 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.195079 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:15.195098 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:15.198564 (+ 3466us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":307,"threads_started":1}
W20260812 11:18:15.199066 31399 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:15.189350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:54815 (local address 127.15.164.254:41211)
0812 11:18:15.189531 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:15.189536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:15.189902 (+ 366us) server_negotiation.cc:407] Connection header received
0812 11:18:15.190040 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:15.190044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:15.190107 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:15.190208 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:15.191228 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.192065 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.193504 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.193956 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.194062 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.198853 (+ 4791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:54815: BlockingRecv error: recv got EOF from 127.15.164.193:54815 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:15.210042 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:15.201449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:50973)
0812 11:18:15.201965 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:15.201982 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:15.202094 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:15.202417 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:15.202420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:15.202895 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:15.203048 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.203058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.204306 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.204311 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.205275 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.205289 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.205999 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.206004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.206141 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.206846 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:15.206865 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:15.209806 (+ 2941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":296,"threads_started":1}
W20260812 11:18:15.210379 31399 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:15.201530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:50973 (local address 127.15.164.254:41211)
0812 11:18:15.201732 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:15.201736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:15.202062 (+ 326us) server_negotiation.cc:407] Connection header received
0812 11:18:15.202222 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:15.202226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:15.202286 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:15.202366 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:15.203213 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.204113 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.205422 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.205846 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.205948 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.210020 (+ 4072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:50973: BlockingRecv error: recv got EOF from 127.15.164.195:50973 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:15 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:15.724591 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:15.715112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:55443)
0812 11:18:15.715678 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:15.715695 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:15.715806 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:15.716331 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:15.716336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:15.716799 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:15.716967 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.716978 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.718374 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.718379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.719703 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:15.719717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.720445 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.720450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:15.720563 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.721266 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:15.721284 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:15.724240 (+ 2956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":285,"threads_started":1}
W20260812 11:18:15.724784 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:15.715328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:55443 (local address 127.15.164.254:41211)
0812 11:18:15.715990 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:15.715995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:15.716011 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:18:15.716060 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:15.716064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:15.716134 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:15.716236 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:15.717179 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.718202 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.719854 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:15.720280 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:15.720378 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:15.724452 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:55443: BlockingRecv error: recv got EOF from 127.15.164.194:55443 (error 108)
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":454,"threads_started":1}
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:16.209157 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:16.200255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:50997)
0812 11:18:16.200798 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:16.200816 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:16.200935 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:16.201372 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:16.201377 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:16.201772 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:16.201947 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.201956 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.203393 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.203397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.204363 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.204376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.205182 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.205186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.205334 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.206020 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:16.206038 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:16.208894 (+ 2856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":274,"threads_started":1}
W20260812 11:18:16.209353 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:16.200311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:50997 (local address 127.15.164.254:41211)
0812 11:18:16.200595 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:16.200603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:16.200909 (+ 306us) server_negotiation.cc:407] Connection header received
0812 11:18:16.201067 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:16.201073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:16.201170 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:16.201318 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:16.202129 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.203251 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.204498 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.205039 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.205151 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.209117 (+ 3966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:50997: BlockingRecv error: recv got EOF from 127.15.164.193:50997 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:16.219852 31406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:16.211233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:48437)
0812 11:18:16.211801 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:16.211818 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:16.211969 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:16.212318 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:16.212323 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:16.212712 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:16.212872 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.212881 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.213996 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.214000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.215089 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.215101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.215836 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.215844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.215993 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.216519 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:16.216536 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:16.219593 (+ 3057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":274,"threads_started":1}
W20260812 11:18:16.220311 31403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:16.211285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:48437 (local address 127.15.164.254:41211)
0812 11:18:16.211581 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:16.211588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:16.211901 (+ 313us) server_negotiation.cc:407] Connection header received
0812 11:18:16.212099 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:16.212110 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:16.212167 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:16.212289 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:16.213031 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.213847 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.215235 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.215638 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.215768 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.219861 (+ 4093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:48437: BlockingRecv error: recv got EOF from 127.15.164.195:48437 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:16 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:16.735464 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:16.725880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:37971)
0812 11:18:16.726373 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:16.726390 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:16.726575 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:16.727116 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:16.727121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:16.727512 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:16.727731 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.727740 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.728966 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.728972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.729953 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:16.729969 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.730972 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.730979 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:16.731132 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.731931 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:16.731951 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:16.735196 (+ 3245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":262,"threads_started":1}
W20260812 11:18:16.735674 31413 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:16.725998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:37971 (local address 127.15.164.254:41211)
0812 11:18:16.726804 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:16.726810 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:16.726828 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:18:16.726882 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:16.726885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:16.726958 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:16.727058 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:16.727898 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.728803 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.730151 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:16.730800 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:16.730908 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:16.735409 (+ 4501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:37971: BlockingRecv error: recv got EOF from 127.15.164.194:37971 (error 108)
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":577,"threads_started":1}
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.193@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:17.220811 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:17.210425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.193:57719)
0812 11:18:17.211082 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:17.211100 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:17.211295 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:17.211697 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:17.211702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:17.212193 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:17.212376 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.212387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.213699 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.213704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.214846 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.214861 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.215674 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.215681 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.215864 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.216688 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:17.216710 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:17.220389 (+ 3679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":362,"threads_started":1}
W20260812 11:18:17.220938 31413 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:17.210566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:57719 (local address 127.15.164.254:41211)
0812 11:18:17.210857 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:17.210865 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:17.211200 (+ 335us) server_negotiation.cc:407] Connection header received
0812 11:18:17.211458 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:17.211472 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:17.211544 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:17.211660 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:17.212540 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.213529 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.215016 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.215502 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.215655 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.220652 (+ 4997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.193:57719: BlockingRecv error: recv got EOF from 127.15.164.193:57719 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.195@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:17.231298 31416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:17.220896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.195:55107)
0812 11:18:17.221635 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:17.221652 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:17.221826 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:17.222198 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:17.222203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:17.222706 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:17.222903 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.222913 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.224034 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.224041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.225138 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.225152 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.226036 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.226043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.226246 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.227009 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:17.227033 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:17.230884 (+ 3851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":506,"threads_started":1}
W20260812 11:18:17.231426 31413 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:17.221106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:55107 (local address 127.15.164.254:41211)
0812 11:18:17.221292 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:17.221298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:17.221747 (+ 449us) server_negotiation.cc:407] Connection header received
0812 11:18:17.221977 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:17.221981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:17.222046 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:17.222163 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:17.223068 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.223866 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.225295 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.225870 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.226019 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.231121 (+ 5102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.195:55107: BlockingRecv error: recv got EOF from 127.15.164.195:55107 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:18:17 dist-test-slave-7kzw krb5kdc[29656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.164.194@KRBTEST.COM for oryx/127.15.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:18:17.746752 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:17.736706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41211 (local address 127.15.164.194:40749)
0812 11:18:17.737229 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:17.737247 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:17.737361 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:17.737935 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:17.737941 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:17.738531 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:17.738715 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.738725 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.739974 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.739983 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.741116 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:17.741131 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.741969 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.741976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:17.742158 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.742949 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:17.742970 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:17.746337 (+ 3367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.164.254:41211: Server oryx/127.15.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":260,"threads_started":1}
W20260812 11:18:17.746964 31420 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:17.736761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:40749 (local address 127.15.164.254:41211)
0812 11:18:17.737632 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:17.737636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:17.737652 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:18:17.737698 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:17.737701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:17.737771 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:17.737899 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:17.738865 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.739749 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.741272 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:17.741797 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:17.741939 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:17.746643 (+ 4704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.164.194:40749: BlockingRecv error: recv got EOF from 127.15.164.194:40749 (error 108)
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":549,"threads_started":1}
I20260812 11:18:18.045322 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30654
I20260812 11:18:18.060169 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:18.046750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39904 (local address 127.15.164.193:36995)
0812 11:18:18.047556 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:18.047567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:18.047612 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:18:18.047682 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:18.047690 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:18.047968 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:18.048156 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:18.049926 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.051148 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.052679 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.053377 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.053503 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:18.056595 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:18.056605 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:18.056622 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:18.056664 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:18.059569 (+ 2905us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:18:18.059878 (+ 309us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39904: Request ticket server kudu/127.15.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":422,"threads_started":1}
W20260812 11:18:18.060298 31423 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39904: Request ticket server kudu/127.15.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:18:18.060377 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30654: Not authorized: Client connection negotiation failed: client connection to 127.15.164.193:36995: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:18:18.060633 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 30654
I20260812 11:18:18.089751 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30907
I20260812 11:18:18.104050 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:18.091189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.15.164.194:46075)
0812 11:18:18.091845 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:18.091853 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:18.091890 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:18:18.091958 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:18.091965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:18.092195 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:18.092416 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:18.093838 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.095019 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.096226 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.097059 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.097189 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:18.100286 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:18.100297 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:18.100313 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:18.100351 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:18.103409 (+ 3058us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:18:18.103784 (+ 375us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51526: Request ticket server kudu/127.15.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":305,"threads_started":1}
W20260812 11:18:18.104259 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30907: Not authorized: Client connection negotiation failed: client connection to 127.15.164.194:46075: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:18:18.104326 31424 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51526: Request ticket server kudu/127.15.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:18:18.104434 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 30907
I20260812 11:18:18.132313 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 31125
I20260812 11:18:18.147614 31425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:18.133627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49172 (local address 127.15.164.195:45269)
0812 11:18:18.134351 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:18.134359 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:18.134389 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:18:18.134768 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:18.134782 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:18.135034 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:18.135222 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:18.136695 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.137892 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.139464 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.140112 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.140242 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:18.143696 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:18.143706 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:18.143723 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:18.143768 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:18.146960 (+ 3192us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:18:18.147304 (+ 344us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49172: Request ticket server kudu/127.15.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":381,"threads_started":1}
W20260812 11:18:18.147734 31425 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49172: Request ticket server kudu/127.15.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:18:18.147794 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 31125: Not authorized: Client connection negotiation failed: client connection to 127.15.164.195:45269: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.15.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:18:18.148020 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 31125
I20260812 11:18:18.179507 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 30532
I20260812 11:18:18.181285 30640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:18.302553 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 30532
2026-08-12T11:18:18Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22071 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T11:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:18:18Z Disabled control of system clock
I20260812 11:18:18.407810 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40699
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:44203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:18:18.775102 31433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:18.775444 31433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:18.775585 31433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:18.783236 31433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:18:18.783365 31433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:18.783404 31433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:18.783496 31433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:18:18.783572 31433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:18:18.793417 31433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:18.794951 31433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:18.796877 31433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:18.811319 31441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:18.811381 31442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:18.811347 31444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:18.812104 31433 server_base.cc:1034] running on GCE node
I20260812 11:18:18.813040 31433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:18.814738 31433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:18.816010 31433 hybrid_clock.cc:648] HybridClock initialized: now 1786533498815948 us; error 55 us; skew 500 ppm
I20260812 11:18:18.816434 31433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:18.822947 31433 webserver.cc:460] Webserver started at http://127.15.164.254:40973/ using document root <none> and password file <none>
I20260812 11:18:18.823832 31433 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:18.823999 31433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:18.824402 31433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:18.828028 31433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "c7206ad99ec448e09191f68603461f3c"
format_stamp: "Formatted at 2026-08-12 11:18:18 on dist-test-slave-7kzw"
server_key: "fed659e7f6ef770b2a6e40c3c5d92d3d"
server_key_iv: "25ba2cecee65661f36a79c9de69e9a73"
server_key_version: "encryptionkey@0"
I20260812 11:18:18.828984 31433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "c7206ad99ec448e09191f68603461f3c"
format_stamp: "Formatted at 2026-08-12 11:18:18 on dist-test-slave-7kzw"
server_key: "fed659e7f6ef770b2a6e40c3c5d92d3d"
server_key_iv: "25ba2cecee65661f36a79c9de69e9a73"
server_key_version: "encryptionkey@0"
I20260812 11:18:18.835052 31433 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:18:18.838990 31459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:18.840530 31433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:18.840802 31433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "c7206ad99ec448e09191f68603461f3c"
format_stamp: "Formatted at 2026-08-12 11:18:18 on dist-test-slave-7kzw"
server_key: "fed659e7f6ef770b2a6e40c3c5d92d3d"
server_key_iv: "25ba2cecee65661f36a79c9de69e9a73"
server_key_version: "encryptionkey@0"
I20260812 11:18:18.841058 31433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:18.870738 31433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:18.871766 31433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:18.872088 31433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:18.892303 31433 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40699
I20260812 11:18:18.892328 31546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40699 every 8 connection(s)
I20260812 11:18:18.893766 31433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:18:18.898074 31547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:18.899976 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 31433
I20260812 11:18:18.900208 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:18:18.900879 16019 external_mini_cluster.cc:1428] Setting key d4fc73cddcc55d2100446ae9eff30717
I20260812 11:18:18.910234 31547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c: Bootstrap starting.
I20260812 11:18:18.914675 31547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:18.916105 31552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:18.903089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46454 (local address 127.15.164.254:40699)
0812 11:18:18.904185 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:18.904197 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:18.904245 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:18:18.905995 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:18.906019 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:18.906560 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:18.907001 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:18.907667 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.909023 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.910446 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:18.911502 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:18.911703 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:18.913020 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:18.913031 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:18.913048 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:18.913800 (+ 752us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:18.913926 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:18.913953 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:18.914099 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:18.914347 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 11:18:18.914751 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":375,"threads_started":1}
I20260812 11:18:18.916085 31547 log.cc:824] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:18.919260 31547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c: No bootstrap required, opened a new log
I20260812 11:18:18.926640 31547 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } }
I20260812 11:18:18.927044 31547 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:18.927142 31547 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7206ad99ec448e09191f68603461f3c, State: Initialized, Role: FOLLOWER
I20260812 11:18:18.927770 31547 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } }
I20260812 11:18:18.927979 31547 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:18:18.928145 31547 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:18:18.928333 31547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:18.930662 31547 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } }
I20260812 11:18:18.931209 31547 leader_election.cc:302] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7206ad99ec448e09191f68603461f3c; no voters:
I20260812 11:18:18.931864 31547 leader_election.cc:288] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:18:18.932024 31554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:18:18.932899 31554 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [term 1 LEADER]: Becoming Leader. State: Replica: c7206ad99ec448e09191f68603461f3c, State: Running, Role: LEADER
I20260812 11:18:18.933506 31554 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } }
I20260812 11:18:18.934161 31547 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:18:18.936678 31555 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7206ad99ec448e09191f68603461f3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } } }
I20260812 11:18:18.936748 31556 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7206ad99ec448e09191f68603461f3c. Latest consensus state: current_term: 1 leader_uuid: "c7206ad99ec448e09191f68603461f3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7206ad99ec448e09191f68603461f3c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40699 } } }
I20260812 11:18:18.937103 31555 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:18.937201 31556 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:18.938928 31570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:18:18.945770 31570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:18:18.955338 31570 catalog_manager.cc:1347] Generated new cluster ID: 6be1a9159cf548c29b42ac5a28939ea8
I20260812 11:18:18.955482 31570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:18:18.963748 31570 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:18:18.965667 31570 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:18:18.977002 31570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7206ad99ec448e09191f68603461f3c: Generated new TSK 0
I20260812 11:18:18.978096 31570 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:18:18.990702 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--builtin_ntp_servers=127.15.164.212:44203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 11:18:19.356313 31593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:19.356662 31593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:19.356830 31593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:19.364192 31593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:19.364327 31593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:19.364501 31593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:18:19.373804 31593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:19.375231 31593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:19.377072 31593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:19.391244 31601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:19.391203 31607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:19.391203 31602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:19.392624 31593 server_base.cc:1034] running on GCE node
I20260812 11:18:19.393267 31593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:19.394297 31593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:19.395536 31593 hybrid_clock.cc:648] HybridClock initialized: now 1786533499395461 us; error 65 us; skew 500 ppm
I20260812 11:18:19.395850 31593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:19.398206 31593 webserver.cc:460] Webserver started at http://127.15.164.193:34111/ using document root <none> and password file <none>
I20260812 11:18:19.398990 31593 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:19.399081 31593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:19.399392 31593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:19.402293 31593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "20990e22d65f428da18dc53286285f1d"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9834b97e5461ddfe1ce46e9d71375fa1"
server_key_iv: "8aa49e6275cbba15430261c22226799a"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.403154 31593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "20990e22d65f428da18dc53286285f1d"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9834b97e5461ddfe1ce46e9d71375fa1"
server_key_iv: "8aa49e6275cbba15430261c22226799a"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.408676 31593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:18:19.412461 31613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.414002 31593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:18:19.414203 31593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "20990e22d65f428da18dc53286285f1d"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9834b97e5461ddfe1ce46e9d71375fa1"
server_key_iv: "8aa49e6275cbba15430261c22226799a"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.414413 31593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:19.431356 31593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:19.432147 31593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:19.432406 31593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:19.433338 31593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:19.435058 31593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:19.435191 31593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.435334 31593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:19.435398 31593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.471450 31593 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:42055
I20260812 11:18:19.471554 31808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:42055 every 8 connection(s)
I20260812 11:18:19.472873 31593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:18:19.482331 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 31593
I20260812 11:18:19.482586 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:18:19.483263 16019 external_mini_cluster.cc:1428] Setting key b21e93547e4bf7d436ce44b75b1d758b
I20260812 11:18:19.486079 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--builtin_ntp_servers=127.15.164.212:44203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:18:19.487248 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:19.475884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53779 (local address 127.15.164.254:40699)
0812 11:18:19.476420 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:19.476426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:19.477645 (+ 1219us) server_negotiation.cc:407] Connection header received
0812 11:18:19.479686 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:19.479693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:19.479821 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:19.479966 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:19.481125 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.481882 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.483782 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.484387 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.484546 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:19.486078 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:19.486084 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:19.486087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:19.486106 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:19.486151 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:19.486164 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:19.486273 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:19.486709 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 11:18:19.486817 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":311,"threads_started":1}
I20260812 11:18:19.488824 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:19.476465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40699 (local address 127.15.164.193:53779)
0812 11:18:19.477427 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:19.477465 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:19.479347 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:19.480227 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:19.480235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:19.480323 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:19.480934 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:19.480951 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.482074 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.482080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:19.483600 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:19.483615 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.484646 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.484655 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:19.484907 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:19.485700 (+ 793us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:19.485703 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:19.485747 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:19.485829 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:19.486394 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:19.486412 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:19.486419 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:18:19.486696 (+ 277us) client_negotiation.cc:240] Negotiation successful
0812 11:18:19.487105 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":315,"threads_started":1}
I20260812 11:18:19.490612 31810 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40699
I20260812 11:18:19.490971 31810 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:19.491896 31810 heartbeater.cc:511] Master 127.15.164.254:40699 requested a full tablet report, sending...
I20260812 11:18:19.494387 31491 ts_manager.cc:194] Registered new tserver with Master: 20990e22d65f428da18dc53286285f1d (127.15.164.193:42055)
I20260812 11:18:19.496624 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.193:53779
W20260812 11:18:19.847879 31816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:19.848196 31816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:19.848300 31816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:19.856323 31816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:19.856429 31816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:19.856534 31816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:18:19.866891 31816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:19.868326 31816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:19.870375 31816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:19.885349 31822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:19.885407 31824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:19.885322 31826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:19.886623 31816 server_base.cc:1034] running on GCE node
I20260812 11:18:19.887328 31816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:19.888253 31816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:19.889494 31816 hybrid_clock.cc:648] HybridClock initialized: now 1786533499889448 us; error 57 us; skew 500 ppm
I20260812 11:18:19.889834 31816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:19.892570 31816 webserver.cc:460] Webserver started at http://127.15.164.194:33445/ using document root <none> and password file <none>
I20260812 11:18:19.893479 31816 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:19.893604 31816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:19.893970 31816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:19.897768 31816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "e21f101cb6864e17a357140cb58ffb35"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9c55dfda0566e549b20a9843fcf57d68"
server_key_iv: "ed9b2871c285e762491bb5ad4a1c9ca7"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.898808 31816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "e21f101cb6864e17a357140cb58ffb35"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9c55dfda0566e549b20a9843fcf57d68"
server_key_iv: "ed9b2871c285e762491bb5ad4a1c9ca7"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.905373 31816 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:18:19.910090 31833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.911896 31816 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:18:19.912086 31816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "e21f101cb6864e17a357140cb58ffb35"
format_stamp: "Formatted at 2026-08-12 11:18:19 on dist-test-slave-7kzw"
server_key: "9c55dfda0566e549b20a9843fcf57d68"
server_key_iv: "ed9b2871c285e762491bb5ad4a1c9ca7"
server_key_version: "encryptionkey@0"
I20260812 11:18:19.912335 31816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:19.939687 31816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:19.940672 31816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:19.940945 31816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:19.941937 31816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:19.943456 31816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:19.943549 31816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.943624 31816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:19.943684 31816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:19.979923 31816 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:35585
I20260812 11:18:19.980084 32024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:35585 every 8 connection(s)
I20260812 11:18:19.981256 31816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:18:19.991225 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 31816
I20260812 11:18:19.991406 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:18:19.991894 16019 external_mini_cluster.cc:1428] Setting key b67ff5f02f4ccf639820b269d6df5742
I20260812 11:18:19.994805 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--builtin_ntp_servers=127.15.164.212:44203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:18:19.995218 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:19.984001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:45429 (local address 127.15.164.254:40699)
0812 11:18:19.984223 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:19.984228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:19.985718 (+ 1490us) server_negotiation.cc:407] Connection header received
0812 11:18:19.987782 (+ 2064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:19.987789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:19.987890 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:19.988019 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:19.989177 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.990176 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.992136 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.992595 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.992758 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:19.994284 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:19.994299 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:19.994303 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:19.994323 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:19.994357 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:19.994371 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:19.994502 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:19.994765 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 11:18:19.994873 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:18:19.996377 32028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:19.984462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40699 (local address 127.15.164.194:45429)
0812 11:18:19.985442 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:19.985489 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:19.987476 (+ 1987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:19.988276 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:19.988285 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:19.988385 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:19.988985 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:19.989003 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.990373 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.990379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:19.991930 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:19.991971 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:19.992869 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:19.992879 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:19.993132 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:19.993928 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:19.993930 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:19.993977 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:19.994072 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:19.994506 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:19.994521 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:19.994534 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 11:18:19.994743 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 11:18:19.995181 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":300,"threads_started":1}
I20260812 11:18:19.998001 32025 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40699
I20260812 11:18:19.998363 32025 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:19.999250 32025 heartbeater.cc:511] Master 127.15.164.254:40699 requested a full tablet report, sending...
I20260812 11:18:20.000958 31491 ts_manager.cc:194] Registered new tserver with Master: e21f101cb6864e17a357140cb58ffb35 (127.15.164.194:35585)
I20260812 11:18:20.002228 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.194:45429
W20260812 11:18:20.347957 32032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:20.348320 32032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:20.348480 32032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:20.355968 32032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:20.356114 32032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:20.356302 32032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:18:20.365480 32032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:40699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:20.366919 32032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:20.368827 32032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:20.383445 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:20.383412 32042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:20.383366 32040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:20.384140 32032 server_base.cc:1034] running on GCE node
I20260812 11:18:20.384802 32032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:20.385818 32032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:20.387012 32032 hybrid_clock.cc:648] HybridClock initialized: now 1786533500386928 us; error 79 us; skew 500 ppm
I20260812 11:18:20.387473 32032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:20.389858 32032 webserver.cc:460] Webserver started at http://127.15.164.195:34845/ using document root <none> and password file <none>
I20260812 11:18:20.390697 32032 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:20.390838 32032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:20.391204 32032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:20.394218 32032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "2a97672214264089863626c7d43257ad"
format_stamp: "Formatted at 2026-08-12 11:18:20 on dist-test-slave-7kzw"
server_key: "6c07d2ea37a0a6dd6278252af4eb8f2e"
server_key_iv: "18764e6a1cdd00c3767d24819261af8f"
server_key_version: "encryptionkey@0"
I20260812 11:18:20.395159 32032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "2a97672214264089863626c7d43257ad"
format_stamp: "Formatted at 2026-08-12 11:18:20 on dist-test-slave-7kzw"
server_key: "6c07d2ea37a0a6dd6278252af4eb8f2e"
server_key_iv: "18764e6a1cdd00c3767d24819261af8f"
server_key_version: "encryptionkey@0"
I20260812 11:18:20.400720 32032 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:18:20.404850 32051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:20.406600 32032 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:18:20.406771 32032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "2a97672214264089863626c7d43257ad"
format_stamp: "Formatted at 2026-08-12 11:18:20 on dist-test-slave-7kzw"
server_key: "6c07d2ea37a0a6dd6278252af4eb8f2e"
server_key_iv: "18764e6a1cdd00c3767d24819261af8f"
server_key_version: "encryptionkey@0"
I20260812 11:18:20.406982 32032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:20.432888 32032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:20.433813 32032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:20.434175 32032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:20.435422 32032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:20.437260 32032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:20.437358 32032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:20.437520 32032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:20.437604 32032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:20.475144 32032 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:42927
I20260812 11:18:20.475201 32243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:42927 every 8 connection(s)
I20260812 11:18:20.476451 32032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:18:20.486135 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 32032
I20260812 11:18:20.486313 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:18:20.486874 16019 external_mini_cluster.cc:1428] Setting key 462df8c01d8a8cf748520f00dec1a504
I20260812 11:18:20.491282 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:20.479487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:59567 (local address 127.15.164.254:40699)
0812 11:18:20.479726 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:20.479731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:20.481219 (+ 1488us) server_negotiation.cc:407] Connection header received
0812 11:18:20.483341 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:20.483348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:20.483451 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:20.483587 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:20.484724 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.485553 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.487700 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.488348 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.488506 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:20.490239 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:20.490247 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:20.490253 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:20.490278 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:20.490326 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:20.490355 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:20.490513 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:20.490788 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 11:18:20.490897 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260812 11:18:20.492431 32254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:20.479998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40699 (local address 127.15.164.195:59567)
0812 11:18:20.481026 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:20.481072 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:20.483035 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:20.483835 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:20.483844 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:20.483931 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:20.484536 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:20.484554 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.485727 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.485740 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:20.487382 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:20.487405 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.488621 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.488629 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:20.488860 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:20.489816 (+ 956us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:20.489820 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:20.489885 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:20.489997 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:20.490525 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:20.490537 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:20.490547 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:18:20.490777 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 11:18:20.491262 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":324,"threads_started":1}
I20260812 11:18:20.493863 32246 heartbeater.cc:347] Connected to a master server at 127.15.164.254:40699
I20260812 11:18:20.494196 32246 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:20.495023 32246 heartbeater.cc:511] Master 127.15.164.254:40699 requested a full tablet report, sending...
I20260812 11:18:20.496466 31491 ts_manager.cc:194] Registered new tserver with Master: 2a97672214264089863626c7d43257ad (127.15.164.195:42927)
I20260812 11:18:20.497367 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.195:59567
I20260812 11:18:20.500391 31810 heartbeater.cc:503] Master 127.15.164.254:40699 was elected leader, sending a full tablet report...
I20260812 11:18:20.503314 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:18:20.509908 31813 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:20.508119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.15.164.254:40699)
0812 11:18:20.508346 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:20.508355 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:20.508784 (+ 429us) server_negotiation.cc:407] Connection header received
0812 11:18:20.508988 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:20.509001 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:20.509065 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:20.509175 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:20.509637 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46456: BlockingRecv error: recv got EOF from 127.0.0.1:46456 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:18:20.510854 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 31593
I20260812 11:18:20.519554 32263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:20.512123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.15.164.193:42055)
0812 11:18:20.512746 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:20.512754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:20.512780 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:18:20.512835 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:20.512841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:20.513038 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:20.513211 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:20.513665 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.514745 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.516003 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.516679 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.516830 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:20.518099 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:20.518108 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:20.518124 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:20.518780 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:20.518883 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:20.518914 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:20.519009 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:20.519143 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 11:18:20.519254 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":381,"threads_started":1}
I20260812 11:18:20.520809 31798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:20.602869 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 31593
I20260812 11:18:20.627946 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 31816
I20260812 11:18:20.637451 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:20.629089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48080 (local address 127.15.164.194:35585)
0812 11:18:20.629742 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:20.629750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:20.629782 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:18:20.629849 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:20.629856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:20.630089 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:20.630237 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:20.630767 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.631921 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.633388 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.634072 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.634276 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:20.635596 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:20.635606 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:20.635622 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:20.636376 (+ 754us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:20.636429 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:20.636452 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:20.636559 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:20.636947 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 11:18:20.637100 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":313,"threads_started":1}
I20260812 11:18:20.638962 32020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:20.724210 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 31816
I20260812 11:18:20.751701 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 32032
I20260812 11:18:20.760780 32268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:20.752703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42626 (local address 127.15.164.195:42927)
0812 11:18:20.753365 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:20.753372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:20.753405 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:18:20.753473 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:20.753479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:20.753756 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:20.753892 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:20.754400 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.755556 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.756904 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:20.757941 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:20.758046 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:20.759278 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:20.759287 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:20.759302 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:20.759895 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:20.759948 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:20.759970 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:20.760100 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:20.760267 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:18:20.760418 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":338,"threads_started":1}
I20260812 11:18:20.762333 32237 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:20.845057 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 32032
I20260812 11:18:20.875878 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 31433
I20260812 11:18:20.877281 31538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:20.982651 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 31433
2026-08-12T11:18:21Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2668 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T11:18:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:18:21Z Disabled control of system clock
I20260812 11:18:21.076279 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:43929
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:41905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:43929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:18:21.449620 32278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:21.449949 32278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:21.450037 32278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:21.457655 32278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:18:21.457784 32278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:21.457824 32278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:21.457880 32278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:18:21.457926 32278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:18:21.467767 32278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:43929
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:43929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:21.469151 32278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:21.471065 32278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:21.484850 32287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:21.484920 32288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:21.485054 32290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:21.486261 32278 server_base.cc:1034] running on GCE node
I20260812 11:18:21.487257 32278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:21.488888 32278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:21.490161 32278 hybrid_clock.cc:648] HybridClock initialized: now 1786533501490113 us; error 41 us; skew 500 ppm
I20260812 11:18:21.490651 32278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:21.493961 32278 webserver.cc:460] Webserver started at http://127.15.164.254:45561/ using document root <none> and password file <none>
I20260812 11:18:21.494925 32278 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:21.495082 32278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:21.495477 32278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:21.499006 32278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "fb041ceb1b034318a25b819ba73b25bf"
format_stamp: "Formatted at 2026-08-12 11:18:21 on dist-test-slave-7kzw"
server_key: "5e67766cd617d150ebb1f1f0d55004a8"
server_key_iv: "e9a824e721dc7834a16ed1cd31a89aac"
server_key_version: "encryptionkey@0"
I20260812 11:18:21.499969 32278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "fb041ceb1b034318a25b819ba73b25bf"
format_stamp: "Formatted at 2026-08-12 11:18:21 on dist-test-slave-7kzw"
server_key: "5e67766cd617d150ebb1f1f0d55004a8"
server_key_iv: "e9a824e721dc7834a16ed1cd31a89aac"
server_key_version: "encryptionkey@0"
I20260812 11:18:21.506572 32278 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:18:21.510797 32301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:21.512384 32278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:21.512648 32278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "fb041ceb1b034318a25b819ba73b25bf"
format_stamp: "Formatted at 2026-08-12 11:18:21 on dist-test-slave-7kzw"
server_key: "5e67766cd617d150ebb1f1f0d55004a8"
server_key_iv: "e9a824e721dc7834a16ed1cd31a89aac"
server_key_version: "encryptionkey@0"
I20260812 11:18:21.512951 32278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:21.519479 32278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:21.520324 32278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:21.520622 32278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:21.542760 32278 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:43929
I20260812 11:18:21.542870 32379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:43929 every 8 connection(s)
I20260812 11:18:21.544237 32278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:18:21.548545 32381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:21.554152 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 32278
I20260812 11:18:21.554422 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:18:21.555117 16019 external_mini_cluster.cc:1428] Setting key 744d5c46fc3dfb7ac19bdbdaff7a2e82
I20260812 11:18:21.561405 32381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf: Bootstrap starting.
I20260812 11:18:21.564724 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:21.557506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.15.164.254:43929)
0812 11:18:21.558747 (+ 1241us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:21.558758 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:21.558806 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:18:21.560538 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:21.560564 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:21.560993 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:21.561401 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:21.562632 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:21.562639 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:21.562653 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:21.562668 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:21.562739 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:21.562760 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:21.563070 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:21.563261 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 11:18:21.563657 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":396,"threads_started":1}
I20260812 11:18:21.566926 32381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:21.568132 32381 log.cc:824] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:21.571354 32381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf: No bootstrap required, opened a new log
I20260812 11:18:21.579082 32381 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } }
I20260812 11:18:21.579470 32381 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:21.579586 32381 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb041ceb1b034318a25b819ba73b25bf, State: Initialized, Role: FOLLOWER
I20260812 11:18:21.580188 32381 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } }
I20260812 11:18:21.580425 32381 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:18:21.580626 32381 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:18:21.580828 32381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:21.583289 32381 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } }
I20260812 11:18:21.584149 32381 leader_election.cc:302] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb041ceb1b034318a25b819ba73b25bf; no voters:
I20260812 11:18:21.584920 32381 leader_election.cc:288] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:18:21.585031 32390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:18:21.586141 32390 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [term 1 LEADER]: Becoming Leader. State: Replica: fb041ceb1b034318a25b819ba73b25bf, State: Running, Role: LEADER
I20260812 11:18:21.586746 32390 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } }
I20260812 11:18:21.588104 32381 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:18:21.589604 32391 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb041ceb1b034318a25b819ba73b25bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } } }
I20260812 11:18:21.590135 32391 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:21.590204 32392 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb041ceb1b034318a25b819ba73b25bf. Latest consensus state: current_term: 1 leader_uuid: "fb041ceb1b034318a25b819ba73b25bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb041ceb1b034318a25b819ba73b25bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43929 } } }
I20260812 11:18:21.590580 32392 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:21.592208 32395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:18:21.598381 32395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:18:21.609483 32395 catalog_manager.cc:1347] Generated new cluster ID: 271ccf893ee94db5b80c9adb8bcb32ae
I20260812 11:18:21.609637 32395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:18:21.637161 32395 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:18:21.637651 32395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:18:21.646243 32395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb041ceb1b034318a25b819ba73b25bf: Generated new TSK 0
I20260812 11:18:21.647571 32395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:18:21.662508 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--builtin_ntp_servers=127.15.164.212:41905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:18:22.049408 32421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:22.049748 32421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:22.049845 32421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:22.057642 32421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:22.057770 32421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:22.057883 32421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:18:22.067777 32421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:22.069119 32421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:22.071141 32421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:22.087059 32431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:22.086978 32435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:22.087033 32432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:22.088832 32421 server_base.cc:1034] running on GCE node
I20260812 11:18:22.089656 32421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:22.090858 32421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:22.092121 32421 hybrid_clock.cc:648] HybridClock initialized: now 1786533502092050 us; error 59 us; skew 500 ppm
I20260812 11:18:22.092576 32421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:22.095433 32421 webserver.cc:460] Webserver started at http://127.15.164.193:40289/ using document root <none> and password file <none>
I20260812 11:18:22.096271 32421 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:22.096426 32421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:22.096800 32421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:22.100540 32421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "12988eba75454ea593cb00820b45d02f"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "4b43c9250d876f19755acd94ad76ad33"
server_key_iv: "46abf3f3b359512303e31f74365c586d"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.101408 32421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "12988eba75454ea593cb00820b45d02f"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "4b43c9250d876f19755acd94ad76ad33"
server_key_iv: "46abf3f3b359512303e31f74365c586d"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.106773 32421 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:18:22.110435 32444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.111944 32421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:18:22.112133 32421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "12988eba75454ea593cb00820b45d02f"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "4b43c9250d876f19755acd94ad76ad33"
server_key_iv: "46abf3f3b359512303e31f74365c586d"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.112376 32421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:22.118439 32421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:22.119321 32421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:22.119607 32421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:22.120546 32421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:22.122014 32421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:22.122144 32421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.122277 32421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:22.122365 32421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.157784 32421 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:46759
I20260812 11:18:22.158002 32635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:46759 every 8 connection(s)
I20260812 11:18:22.159221 32421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:18:22.159791 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 32421
I20260812 11:18:22.160060 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:18:22.160953 16019 external_mini_cluster.cc:1428] Setting key 6169e30f27ad45335f70e7be875c8719
I20260812 11:18:22.164289 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--builtin_ntp_servers=127.15.164.212:41905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:18:22.168936 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:22.162024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35057 (local address 127.15.164.254:43929)
0812 11:18:22.162562 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:22.162569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:22.163937 (+ 1368us) server_negotiation.cc:407] Connection header received
0812 11:18:22.165695 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:22.165701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:22.165781 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:22.165912 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:22.167506 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:22.167514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:22.167537 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:22.167558 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:22.167608 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:22.167622 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:22.167890 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:22.168124 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 11:18:22.168322 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":275,"threads_started":1}
I20260812 11:18:22.169929 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:22.162703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43929 (local address 127.15.164.193:35057)
0812 11:18:22.163784 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:22.163829 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:22.165424 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:22.166152 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:22.166161 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:22.166254 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:22.167115 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:22.167119 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:22.167171 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:22.167292 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:22.167838 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:22.167851 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:22.167860 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:18:22.168310 (+ 450us) client_negotiation.cc:240] Negotiation successful
0812 11:18:22.168650 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":363,"threads_started":1}
I20260812 11:18:22.171780 32636 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43929
I20260812 11:18:22.172063 32636 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:22.172660 32636 heartbeater.cc:511] Master 127.15.164.254:43929 requested a full tablet report, sending...
I20260812 11:18:22.175161 32327 ts_manager.cc:194] Registered new tserver with Master: 12988eba75454ea593cb00820b45d02f (127.15.164.193:46759)
W20260812 11:18:22.524924 32641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:22.525302 32641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:22.525460 32641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:22.533129 32641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:22.533317 32641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:22.533492 32641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:18:22.543623 32641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:22.545289 32641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:22.547657 32641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:22.562954 32648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:22.562987 32650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:22.563427 32653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:22.563895 32641 server_base.cc:1034] running on GCE node
I20260812 11:18:22.564543 32641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:22.565534 32641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:22.566777 32641 hybrid_clock.cc:648] HybridClock initialized: now 1786533502566714 us; error 50 us; skew 500 ppm
I20260812 11:18:22.567178 32641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:22.569679 32641 webserver.cc:460] Webserver started at http://127.15.164.194:38333/ using document root <none> and password file <none>
I20260812 11:18:22.570415 32641 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:22.570591 32641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:22.570971 32641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:22.573840 32641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "d7407781ca464dfaa3b78e19575184a4"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "5afc50c73909acb146b13ed1cbe619c7"
server_key_iv: "a3aba7b34d2522865c91dd04a6d4c53b"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.574745 32641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "d7407781ca464dfaa3b78e19575184a4"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "5afc50c73909acb146b13ed1cbe619c7"
server_key_iv: "a3aba7b34d2522865c91dd04a6d4c53b"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.580111 32641 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:18:22.583910 32662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.585318 32641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:22.585513 32641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "d7407781ca464dfaa3b78e19575184a4"
format_stamp: "Formatted at 2026-08-12 11:18:22 on dist-test-slave-7kzw"
server_key: "5afc50c73909acb146b13ed1cbe619c7"
server_key_iv: "a3aba7b34d2522865c91dd04a6d4c53b"
server_key_version: "encryptionkey@0"
I20260812 11:18:22.585778 32641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:22.592103 32641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:22.593014 32641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:22.593297 32641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:22.594341 32641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:22.595856 32641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:22.595947 32641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.596101 32641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:22.596201 32641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:22.634059 32641 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:44921
I20260812 11:18:22.634116 371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:44921 every 8 connection(s)
I20260812 11:18:22.635464 32641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:18:22.636144 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 32641
I20260812 11:18:22.636353 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:18:22.636998 16019 external_mini_cluster.cc:1428] Setting key 70d67aed1323869b6c9b14fbe1cc33ed
I20260812 11:18:22.640353 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--builtin_ntp_servers=127.15.164.212:41905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:18:22.644973 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:22.638604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:52523 (local address 127.15.164.254:43929)
0812 11:18:22.638796 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:22.638801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:22.640613 (+ 1812us) server_negotiation.cc:407] Connection header received
0812 11:18:22.642364 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:22.642370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:22.642444 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:22.642609 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:22.644115 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:22.644123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:22.644129 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:22.644154 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:22.644190 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:22.644203 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:22.644368 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:22.644584 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 11:18:22.644664 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:18:22.646024 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:22.639318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43929 (local address 127.15.164.194:52523)
0812 11:18:22.640452 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:22.640498 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:22.642083 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:22.642859 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:22.642868 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:22.642958 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:22.643746 (+ 788us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:22.643750 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:22.643799 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:22.643897 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:22.644322 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:22.644336 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:22.644347 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 11:18:22.644679 (+ 332us) client_negotiation.cc:240] Negotiation successful
0812 11:18:22.644949 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":363,"threads_started":1}
I20260812 11:18:22.647805 375 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43929
I20260812 11:18:22.648161 375 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:22.648833 375 heartbeater.cc:511] Master 127.15.164.254:43929 requested a full tablet report, sending...
I20260812 11:18:22.650693 32327 ts_manager.cc:194] Registered new tserver with Master: d7407781ca464dfaa3b78e19575184a4 (127.15.164.194:44921)
W20260812 11:18:23.000411 379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:23.000782 379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:23.000967 379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:23.008131 379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:23.008234 379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:23.008419 379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:18:23.017700 379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:41905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:23.019052 379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:23.020845 379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:23.034582 387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:23.035113 395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:23.035177 389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:23.035820 379 server_base.cc:1034] running on GCE node
I20260812 11:18:23.036439 379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:23.037392 379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:23.038630 379 hybrid_clock.cc:648] HybridClock initialized: now 1786533503038561 us; error 68 us; skew 500 ppm
I20260812 11:18:23.039037 379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:18:23.041365 379 webserver.cc:460] Webserver started at http://127.15.164.195:35711/ using document root <none> and password file <none>
I20260812 11:18:23.042026 379 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:23.042112 379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:23.042419 379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:23.045287 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "efbf96ccbd2048a2a7cf3491dca9c72e"
format_stamp: "Formatted at 2026-08-12 11:18:23 on dist-test-slave-7kzw"
server_key: "bafab1abf26321c78a10d129f977ac90"
server_key_iv: "40bbcd22380e0824dbd01370a0f3d6f6"
server_key_version: "encryptionkey@0"
I20260812 11:18:23.046041 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "efbf96ccbd2048a2a7cf3491dca9c72e"
format_stamp: "Formatted at 2026-08-12 11:18:23 on dist-test-slave-7kzw"
server_key: "bafab1abf26321c78a10d129f977ac90"
server_key_iv: "40bbcd22380e0824dbd01370a0f3d6f6"
server_key_version: "encryptionkey@0"
I20260812 11:18:23.051445 379 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:18:23.055222 403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:23.056838 379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:23.057194 379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "efbf96ccbd2048a2a7cf3491dca9c72e"
format_stamp: "Formatted at 2026-08-12 11:18:23 on dist-test-slave-7kzw"
server_key: "bafab1abf26321c78a10d129f977ac90"
server_key_iv: "40bbcd22380e0824dbd01370a0f3d6f6"
server_key_version: "encryptionkey@0"
I20260812 11:18:23.057443 379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:23.063905 379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:23.064759 379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:23.065023 379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:23.066001 379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:23.067636 379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:23.067739 379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:23.067834 379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:23.067889 379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:23.104707 379 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:46471
I20260812 11:18:23.104755 579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:46471 every 8 connection(s)
I20260812 11:18:23.106066 379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:18:23.112382 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 379
I20260812 11:18:23.112604 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:18:23.113214 16019 external_mini_cluster.cc:1428] Setting key 90d09b81d8490beda03afb03d35d86ba
I20260812 11:18:23.115600 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:23.109098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:59981 (local address 127.15.164.254:43929)
0812 11:18:23.109306 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:23.109311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:23.110741 (+ 1430us) server_negotiation.cc:407] Connection header received
0812 11:18:23.112767 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:23.112774 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:23.112837 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:23.112927 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:23.114742 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:23.114749 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:23.114753 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:23.114776 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:23.114820 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:23.114844 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:23.114940 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:23.115239 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 11:18:23.115307 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:18:23.116852 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:23.109514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43929 (local address 127.15.164.195:59981)
0812 11:18:23.110568 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:23.110607 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:23.112406 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:23.113211 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:23.113224 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:23.113351 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:23.114276 (+ 925us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:18:23.114279 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:23.114342 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:18:23.114453 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:23.114960 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:23.114972 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:23.114982 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:18:23.115296 (+ 314us) client_negotiation.cc:240] Negotiation successful
0812 11:18:23.115567 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":304,"threads_started":1}
I20260812 11:18:23.118227 580 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43929
I20260812 11:18:23.118594 580 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:23.119191 580 heartbeater.cc:511] Master 127.15.164.254:43929 requested a full tablet report, sending...
I20260812 11:18:23.120683 32327 ts_manager.cc:194] Registered new tserver with Master: efbf96ccbd2048a2a7cf3491dca9c72e (127.15.164.195:46471)
I20260812 11:18:23.129226 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:18:23.136013 32638 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:18:23.134082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.15.164.254:43929)
0812 11:18:23.134272 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:23.134277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:23.134925 (+ 648us) server_negotiation.cc:407] Connection header received
0812 11:18:23.135130 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:23.135139 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:23.135209 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:23.135320 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:23.135717 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37546: BlockingRecv error: recv got EOF from 127.0.0.1:37546 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:18:23.136830 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 32421
I20260812 11:18:23.140811 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:23.138042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49314 (local address 127.15.164.193:46759)
0812 11:18:23.138672 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:23.138680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:23.138707 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:18:23.138768 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:23.138774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:23.138987 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:23.139115 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:23.140150 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:23.140157 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:23.140169 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:23.140190 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:23.140235 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:23.140250 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:23.140357 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:23.140441 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 11:18:23.140521 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":304,"threads_started":1}
I20260812 11:18:23.142146 32631 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:23.225024 32636 heartbeater.cc:503] Master 127.15.164.254:43929 was elected leader, sending a full tablet report...
I20260812 11:18:23.227025 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 32421
I20260812 11:18:23.253662 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 32641
I20260812 11:18:23.257388 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:23.254692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46976 (local address 127.15.164.194:44921)
0812 11:18:23.255247 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:23.255263 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:23.255293 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:18:23.255361 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:23.255368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:23.255595 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:23.255730 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:23.256700 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:23.256707 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:23.256719 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:23.256733 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:23.256780 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:23.256797 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:23.256904 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:23.257037 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 11:18:23.257129 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":259,"threads_started":1}
I20260812 11:18:23.258968 367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:23.344313 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 32641
I20260812 11:18:23.373360 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 379
I20260812 11:18:23.377414 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:23.374273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42882 (local address 127.15.164.195:46471)
0812 11:18:23.374913 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:23.374921 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:23.374953 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:18:23.375017 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:23.375025 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:23.375268 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:23.375447 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:23.376648 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:23.376654 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:23.376666 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:18:23.376677 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:23.376719 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:18:23.376736 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:23.376929 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:23.376999 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 11:18:23.377126 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":318,"threads_started":1}
I20260812 11:18:23.378840 574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:23.461304 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 379
I20260812 11:18:23.486927 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 32278
I20260812 11:18:23.488234 32371 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:23.591416 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 32278
2026-08-12T11:18:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2607 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:18:23 dist-test-slave-7kzw krb5kdc[618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:18:23 dist-test-slave-7kzw krb5kdc[618](info): set up 2 sockets
Aug 12 11:18:23 dist-test-slave-7kzw krb5kdc[618](info): commencing operation
krb5kdc: starting...
W20260812 11:18:24.981181 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:18:25 dist-test-slave-7kzw krb5kdc[618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:18:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:18:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:18:25.294914 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:43139
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:43139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:25.654848 646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:25.655161 646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:25.655254 646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:25.663898 646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:18:25.664072 646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:25.664165 646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:25.664260 646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:18:25.664335 646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:18:25.675860 646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:43139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:43139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:25.677201 646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:25.678426 646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:25.690416 660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:25.690308 665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:25.690424 661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:25.691502 646 server_base.cc:1034] running on GCE node
I20260812 11:18:25.692262 646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:25.693608 646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:25.694831 646 hybrid_clock.cc:648] HybridClock initialized: now 1786533505694771 us; error 43 us; skew 500 ppm
I20260812 11:18:25.695194 646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:25 dist-test-slave-7kzw krb5kdc[618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:25.698455 646 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:18:25.700054 646 webserver.cc:460] Webserver started at http://127.15.164.254:37771/ using document root <none> and password file <none>
I20260812 11:18:25.700763 646 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:25.700911 646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:25.701236 646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:25.704267 646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "2b52e5393371458481178da607fb5824"
format_stamp: "Formatted at 2026-08-12 11:18:25 on dist-test-slave-7kzw"
server_key: "a096a7aa9a2d81294f693cf7d57f1e7b"
server_key_iv: "b0c8677b81eee71dd287e74b45a618e1"
server_key_version: "encryptionkey@0"
I20260812 11:18:25.705046 646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "2b52e5393371458481178da607fb5824"
format_stamp: "Formatted at 2026-08-12 11:18:25 on dist-test-slave-7kzw"
server_key: "a096a7aa9a2d81294f693cf7d57f1e7b"
server_key_iv: "b0c8677b81eee71dd287e74b45a618e1"
server_key_version: "encryptionkey@0"
I20260812 11:18:25.710281 646 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:18:25.713970 674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:25.715814 646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:25.716028 646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "2b52e5393371458481178da607fb5824"
format_stamp: "Formatted at 2026-08-12 11:18:25 on dist-test-slave-7kzw"
server_key: "a096a7aa9a2d81294f693cf7d57f1e7b"
server_key_iv: "b0c8677b81eee71dd287e74b45a618e1"
server_key_version: "encryptionkey@0"
I20260812 11:18:25.716292 646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:25.741014 646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:25.745882 646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:25.746153 646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:25.765132 646 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:43139
I20260812 11:18:25.765159 746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:43139 every 8 connection(s)
I20260812 11:18:25.766705 646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:18:25.770810 747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:25.775313 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 646
I20260812 11:18:25.775589 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:18:25.776274 16019 external_mini_cluster.cc:1428] Setting key 8abc8d80b007ab03654316ddff553451
I20260812 11:18:25.782274 747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: Bootstrap starting.
I20260812 11:18:25.785998 747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:25.787257 747 log.cc:824] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:25.790045 747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: No bootstrap required, opened a new log
Aug 12 11:18:25 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:18:25.801060 751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:25.778338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50046 (local address 127.15.164.254:43139)
0812 11:18:25.779270 (+ 932us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:25.779282 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:25.779328 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:18:25.781023 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:25.781046 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:25.781410 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:25.781722 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:25.783695 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:25.785050 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:25.786865 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:25.787591 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:25.787732 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:25.791864 (+ 4132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:25.791875 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:25.791899 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:25.791943 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:25.796109 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:25.796845 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:25.796855 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:25.796863 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:25.797076 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:25.797493 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:25.797498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:25.797502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:25.798238 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:25.798614 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:25.799160 (+ 546us) server_negotiation.cc:299] Negotiation successful
0812 11:18:25.799646 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":442,"threads_started":1}
I20260812 11:18:25.800872 747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } }
I20260812 11:18:25.801347 747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:25.801460 747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b52e5393371458481178da607fb5824, State: Initialized, Role: FOLLOWER
I20260812 11:18:25.802145 747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } }
I20260812 11:18:25.802452 747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:18:25.802641 747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:18:25.802891 747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:25.805428 747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } }
I20260812 11:18:25.805928 747 leader_election.cc:302] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b52e5393371458481178da607fb5824; no voters:
I20260812 11:18:25.806583 747 leader_election.cc:288] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:18:25.806738 754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:18:25.807530 754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [term 1 LEADER]: Becoming Leader. State: Replica: 2b52e5393371458481178da607fb5824, State: Running, Role: LEADER
I20260812 11:18:25.808095 754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } }
I20260812 11:18:25.808773 747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:18:25.811098 756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b52e5393371458481178da607fb5824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } } }
I20260812 11:18:25.811482 757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b52e5393371458481178da607fb5824. Latest consensus state: current_term: 1 leader_uuid: "2b52e5393371458481178da607fb5824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b52e5393371458481178da607fb5824" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 43139 } } }
I20260812 11:18:25.812086 756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:25.812096 757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824 [sys.catalog]: This master's current role is: LEADER
I20260812 11:18:25.813292 767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:18:25.819733 767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:18:25.831157 767 catalog_manager.cc:1347] Generated new cluster ID: 29ea4daf476a46bebd2a8e99d6bdb49e
I20260812 11:18:25.831278 767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:18:25.854404 767 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:18:25.856339 767 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:18:25.879817 767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: Generated new TSK 0
I20260812 11:18:25.880800 767 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:18:25.955096 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:26.315701 783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:26.316074 783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:26.316256 783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:26.324668 783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:26.324836 783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:26.325024 783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:18:26.336386 783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:26.337895 783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:26.339438 783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:26.354228 792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:26.354489 795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:26.354408 797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:26.355541 783 server_base.cc:1034] running on GCE node
I20260812 11:18:26.356277 783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:26.357323 783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:26.358588 783 hybrid_clock.cc:648] HybridClock initialized: now 1786533506358524 us; error 43 us; skew 500 ppm
I20260812 11:18:26.358963 783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:26 dist-test-slave-7kzw krb5kdc[618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533506, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:26.362618 783 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:18:26.364338 783 webserver.cc:460] Webserver started at http://127.15.164.193:40163/ using document root <none> and password file <none>
I20260812 11:18:26.365109 783 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:26.365276 783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:26.365612 783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:26.368937 783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "f1a4d5c2b1164fd588c72dd5b76bd778"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "0d532ad6c8cf189e617cf9c52b0421de"
server_key_iv: "e5f44c12f1f07fbcb8b2a05f1c8b8675"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.369841 783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "f1a4d5c2b1164fd588c72dd5b76bd778"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "0d532ad6c8cf189e617cf9c52b0421de"
server_key_iv: "e5f44c12f1f07fbcb8b2a05f1c8b8675"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.375622 783 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 11:18:26.379431 807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.380858 783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:18:26.381059 783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "f1a4d5c2b1164fd588c72dd5b76bd778"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "0d532ad6c8cf189e617cf9c52b0421de"
server_key_iv: "e5f44c12f1f07fbcb8b2a05f1c8b8675"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.381295 783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:26.396061 783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:26.400589 783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:26.400941 783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:26.402047 783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:26.403641 783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:26.403757 783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.403923 783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:26.404007 783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.441651 783 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:44543
I20260812 11:18:26.441700 986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:44543 every 8 connection(s)
I20260812 11:18:26.443085 783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:18:26.445355 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 783
I20260812 11:18:26.445601 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:18:26.446450 16019 external_mini_cluster.cc:1428] Setting key 277900fce2e532b44b56d3ef012e0bf4
Aug 12 11:18:26 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533506, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:18:26.467486 992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:26.447434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:39341 (local address 127.15.164.254:43139)
0812 11:18:26.447973 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:26.447981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:26.448238 (+ 257us) server_negotiation.cc:407] Connection header received
0812 11:18:26.450808 (+ 2570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:26.450814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:26.450908 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:26.451023 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:26.453180 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:26.454154 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:26.456288 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:26.456857 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:26.456991 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:26.461043 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:26.461049 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:26.461053 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:26.461084 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:26.464335 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:26.465067 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:26.465073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:26.465077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:26.465204 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:26.465647 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:26.465653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:26.465656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:26.465928 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:26.466081 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:26.466859 (+ 778us) server_negotiation.cc:299] Negotiation successful
0812 11:18:26.467085 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":983,"threads_started":1}
I20260812 11:18:26.468492 990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:26.446872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43139 (local address 127.15.164.193:39341)
0812 11:18:26.448047 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:26.448097 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:26.450461 (+ 2364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:26.451296 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:26.451307 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:26.452165 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:26.452982 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:26.453006 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:26.454329 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:26.454336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:26.456074 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:26.456093 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:26.457082 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:26.457089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:26.457393 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:26.458188 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:26.458211 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:26.460821 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:26.464482 (+ 3661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:26.464492 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:26.464509 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:26.464938 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:26.465316 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:26.465321 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:26.465325 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:26.465525 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:26.466057 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:26.466065 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:26.466417 (+ 352us) client_negotiation.cc:769] Sending connection context
0812 11:18:26.466738 (+ 321us) client_negotiation.cc:240] Negotiation successful
0812 11:18:26.467295 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"thread_start_us":661,"threads_started":1}
I20260812 11:18:26.470518 987 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43139
I20260812 11:18:26.470969 987 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:26.471814 987 heartbeater.cc:511] Master 127.15.164.254:43139 requested a full tablet report, sending...
I20260812 11:18:26.474522 697 ts_manager.cc:194] Registered new tserver with Master: f1a4d5c2b1164fd588c72dd5b76bd778 (127.15.164.193:44543)
I20260812 11:18:26.477041 697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:39341
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:18:26.518208 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:26.871698 995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:26.872064 995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:26.872164 995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:26.879990 995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:26.880110 995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:26.880287 995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:18:26.890771 995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:26.892177 995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:26.893544 995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:26.908603 1002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:26.908710 1001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:26.908674 1004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:26.910182 995 server_base.cc:1034] running on GCE node
I20260812 11:18:26.910949 995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:26.912031 995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:26.913282 995 hybrid_clock.cc:648] HybridClock initialized: now 1786533506913231 us; error 45 us; skew 500 ppm
I20260812 11:18:26.913704 995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:26 dist-test-slave-7kzw krb5kdc[618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533506, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:26.917456 995 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:18:26.919196 995 webserver.cc:460] Webserver started at http://127.15.164.194:37635/ using document root <none> and password file <none>
I20260812 11:18:26.919926 995 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:26.920029 995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:26.920295 995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:26.923421 995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "f3dd75dbfcce400280c42ac06639166b"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "a912c6dc4cb54d264338fab30d42f6ba"
server_key_iv: "ecad88a4e1cc96d2fcd0ae867c911d30"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.924168 995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "f3dd75dbfcce400280c42ac06639166b"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "a912c6dc4cb54d264338fab30d42f6ba"
server_key_iv: "ecad88a4e1cc96d2fcd0ae867c911d30"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.929495 995 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 11:18:26.933344 1023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.934970 995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:18:26.935175 995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "f3dd75dbfcce400280c42ac06639166b"
format_stamp: "Formatted at 2026-08-12 11:18:26 on dist-test-slave-7kzw"
server_key: "a912c6dc4cb54d264338fab30d42f6ba"
server_key_iv: "ecad88a4e1cc96d2fcd0ae867c911d30"
server_key_version: "encryptionkey@0"
I20260812 11:18:26.935393 995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:26.952349 995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:26.957208 995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:26.957558 995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:26.958743 995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:26.960333 995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:26.960418 995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.960726 995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:26.960834 995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:26.998456 995 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:37345
I20260812 11:18:26.998572 1212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:37345 every 8 connection(s)
I20260812 11:18:26.999881 995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:18:27.007364 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 995
I20260812 11:18:27.007589 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:18:27.008054 16019 external_mini_cluster.cc:1428] Setting key 8338ecf6669f670c6912d0992768dc90
Aug 12 11:18:27 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533506, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:18:27.024623 1220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.002872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:41919 (local address 127.15.164.254:43139)
0812 11:18:27.003396 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.003403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.004495 (+ 1092us) server_negotiation.cc:407] Connection header received
0812 11:18:27.006509 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.006521 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.006607 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.006724 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:27.008539 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.009478 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.011433 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.012303 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.012477 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.016117 (+ 3640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:27.016128 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:27.016136 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:27.016186 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:27.020673 (+ 4487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.021650 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.021659 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.021666 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.021853 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.022380 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.022389 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.022396 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.022870 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:27.023051 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.024071 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.024268 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":246,"threads_started":1}
I20260812 11:18:27.026193 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.003471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43139 (local address 127.15.164.194:41919)
0812 11:18:27.004322 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.004366 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.006193 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.006943 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.006952 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.007607 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:27.008336 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.008358 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.009656 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.009662 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.011273 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.011286 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.012531 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.012536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.012758 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.013520 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:27.013544 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:27.015884 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:27.020844 (+ 4960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:27.020852 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:27.020866 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:27.021500 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:27.022005 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:27.022009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:27.022012 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:27.022250 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:27.023056 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:27.023077 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:27.023598 (+ 521us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.023945 (+ 347us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.024618 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":322,"threads_started":1}
I20260812 11:18:27.027900 1214 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43139
I20260812 11:18:27.028287 1214 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:27.029160 1214 heartbeater.cc:511] Master 127.15.164.254:43139 requested a full tablet report, sending...
I20260812 11:18:27.031196 697 ts_manager.cc:194] Registered new tserver with Master: f3dd75dbfcce400280c42ac06639166b (127.15.164.194:37345)
I20260812 11:18:27.032569 697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:41919
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:18:27.079063 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:18:27.423521 1224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:18:27.423820 1224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:18:27.423969 1224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:18:27.431201 1224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:18:27.431310 1224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:18:27.431511 1224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:18:27.441478 1224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:43139
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:18:27.442816 1224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:18:27.444111 1224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:18:27.458400 1232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:27.458494 1233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:18:27.458673 1235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:18:27.459429 1224 server_base.cc:1034] running on GCE node
I20260812 11:18:27.460084 1224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:18:27.461079 1224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:18:27.462319 1224 hybrid_clock.cc:648] HybridClock initialized: now 1786533507462257 us; error 54 us; skew 500 ppm
I20260812 11:18:27.462734 1224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:18:27 dist-test-slave-7kzw krb5kdc[618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533507, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:18:27.465997 1224 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:18:27.467593 1224 webserver.cc:460] Webserver started at http://127.15.164.195:43731/ using document root <none> and password file <none>
I20260812 11:18:27.468288 1224 fs_manager.cc:359] Metadata directory not provided
I20260812 11:18:27.468394 1224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:18:27.468653 1224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:18:27.471762 1224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "d1d9267befd94085b4578304137892f6"
format_stamp: "Formatted at 2026-08-12 11:18:27 on dist-test-slave-7kzw"
server_key: "f71d43ec5e3287ab6181be857339ae5b"
server_key_iv: "11b21e2cd60b25cf27b66d1434b2fbc6"
server_key_version: "encryptionkey@0"
I20260812 11:18:27.472523 1224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "d1d9267befd94085b4578304137892f6"
format_stamp: "Formatted at 2026-08-12 11:18:27 on dist-test-slave-7kzw"
server_key: "f71d43ec5e3287ab6181be857339ae5b"
server_key_iv: "11b21e2cd60b25cf27b66d1434b2fbc6"
server_key_version: "encryptionkey@0"
I20260812 11:18:27.478050 1224 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:18:27.480476 987 heartbeater.cc:503] Master 127.15.164.254:43139 was elected leader, sending a full tablet report...
I20260812 11:18:27.482281 1246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:27.483983 1224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:18:27.484180 1224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "d1d9267befd94085b4578304137892f6"
format_stamp: "Formatted at 2026-08-12 11:18:27 on dist-test-slave-7kzw"
server_key: "f71d43ec5e3287ab6181be857339ae5b"
server_key_iv: "11b21e2cd60b25cf27b66d1434b2fbc6"
server_key_version: "encryptionkey@0"
I20260812 11:18:27.484383 1224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:18:27.509455 1224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:18:27.514111 1224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:18:27.514436 1224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:18:27.515473 1224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:18:27.516858 1224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:18:27.516938 1224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:27.517025 1224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:18:27.517069 1224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:18:27.551025 1224 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:38179
I20260812 11:18:27.551059 1449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:38179 every 8 connection(s)
I20260812 11:18:27.552426 1224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:18:27.558296 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 1224
I20260812 11:18:27.558562 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:18:27.559036 16019 external_mini_cluster.cc:1428] Setting key dd3769c67418ad814bab94af59138471
Aug 12 11:18:27 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533507, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:18:27.575598 1456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.555280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:39741 (local address 127.15.164.254:43139)
0812 11:18:27.555897 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.555903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.556669 (+ 766us) server_negotiation.cc:407] Connection header received
0812 11:18:27.558831 (+ 2162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.558840 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.558945 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.559075 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:27.561201 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.562618 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.564380 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.564818 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.564938 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.568809 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:27.568815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:27.568818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:27.568851 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:27.571770 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.572513 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.572518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.572521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.572730 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.573329 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.573333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.573336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.573854 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:27.573990 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.575028 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.575276 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":356,"threads_started":1}
I20260812 11:18:27.576661 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.555680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:43139 (local address 127.15.164.195:39741)
0812 11:18:27.556467 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.556509 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.558421 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.559353 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.559361 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.560144 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:18:27.560964 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.560993 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.562830 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.562835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.564207 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.564221 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.565075 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.565082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.565330 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.566080 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:18:27.566110 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:18:27.568582 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:18:27.571909 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:27.571917 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:27.571931 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:27.572375 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:27.572883 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:18:27.572889 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:18:27.572898 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:18:27.573148 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:18:27.574008 (+ 860us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:18:27.574017 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:18:27.574524 (+ 507us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.574871 (+ 347us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.575421 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":308,"threads_started":1}
I20260812 11:18:27.578182 1451 heartbeater.cc:347] Connected to a master server at 127.15.164.254:43139
I20260812 11:18:27.578563 1451 heartbeater.cc:464] Registering TS with master...
I20260812 11:18:27.579377 1451 heartbeater.cc:511] Master 127.15.164.254:43139 requested a full tablet report, sending...
I20260812 11:18:27.581054 697 ts_manager.cc:194] Registered new tserver with Master: d1d9267befd94085b4578304137892f6 (127.15.164.195:38179)
I20260812 11:18:27.581954 697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:39741
I20260812 11:18:27.587996 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:18:27.605716 1456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.592691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50052 (local address 127.15.164.254:43139)
0812 11:18:27.592925 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.592935 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.593266 (+ 331us) server_negotiation.cc:407] Connection header received
0812 11:18:27.593405 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.593409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.593472 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.593560 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:27.595119 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.595878 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.597090 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.597522 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.597618 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.599860 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:27.599865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:27.599869 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:27.599899 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:27.602442 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.603328 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.603333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.603336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.603490 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.604108 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.604112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.604115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.604493 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:27.604748 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.605124 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.605322 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:18:27.610282 697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:18:27.617347 697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:18:27.640358 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.629770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:37345 (local address 127.0.0.1:58870)
0812 11:18:27.630617 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.630659 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.630864 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.632302 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.632309 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.632341 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:18:27.632855 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.632870 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.635110 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.635116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.637292 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.637311 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.639314 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.639321 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.639503 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.639555 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.639660 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.639862 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":39,"thread_start_us":1198,"threads_started":1}
I20260812 11:18:27.641209 1473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.629979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58870 (local address 127.15.164.194:37345)
0812 11:18:27.631508 (+ 1529us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.631520 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.631555 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:18:27.631654 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.631661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.631983 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.633095 (+ 1112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:18:27.633362 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.634951 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.637485 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.639073 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.640456 (+ 1383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.640659 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.640726 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.640920 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1327,"thread_start_us":1217,"threads_started":1}
I20260812 11:18:27.641819 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.630503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38179 (local address 127.0.0.1:40982)
0812 11:18:27.631855 (+ 1352us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.631874 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.632005 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.633623 (+ 1618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.633628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.633652 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:18:27.634120 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.634135 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.636184 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.636189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.639030 (+ 2841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.639044 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.640879 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.640887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.641086 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.641124 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.641197 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.641336 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1226,"mutex_wait_us":50,"thread_start_us":1060,"threads_started":1}
I20260812 11:18:27.642660 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.631110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40982 (local address 127.15.164.195:38179)
0812 11:18:27.632649 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.632659 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.632696 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:18:27.632798 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.632809 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.633075 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.633299 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:18:27.634381 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.636047 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.639197 (+ 3150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.640372 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.641936 (+ 1564us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.642115 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.642178 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.642301 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1320,"thread_start_us":1157,"threads_started":1}
I20260812 11:18:27.644091 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.631837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:44543 (local address 127.0.0.1:59550)
0812 11:18:27.632903 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.632925 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.633031 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.634146 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.634151 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.634180 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:18:27.634591 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.634602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.637916 (+ 3314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.637922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.640164 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.640181 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.643218 (+ 3037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.643225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.643408 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.643452 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.643552 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.643691 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"mutex_wait_us":2,"thread_start_us":784,"threads_started":1}
I20260812 11:18:27.644129 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.632380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59550 (local address 127.15.164.193:44543)
0812 11:18:27.633584 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.633596 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.633623 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:18:27.633721 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.633728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.633931 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.634778 (+ 847us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:18:27.635016 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.637699 (+ 2683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.640366 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.642988 (+ 2622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.643212 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.643389 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.643608 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.643788 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1012,"thread_start_us":1753,"threads_started":1}
I20260812 11:18:27.645671 1103 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 (DEFAULT_TABLE table=test-table [id=46863cec3d154a6f8851834a3441da31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:18:27.646116 1340 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 (DEFAULT_TABLE table=test-table [id=46863cec3d154a6f8851834a3441da31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:18:27.647360 1103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7c8cfa9af14076940e1381b1649b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:27.647476 1340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7c8cfa9af14076940e1381b1649b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:27.647722 882 tablet_service.cc:1467] Processing CreateTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 (DEFAULT_TABLE table=test-table [id=46863cec3d154a6f8851834a3441da31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:18:27.648763 882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e7c8cfa9af14076940e1381b1649b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:18:27.666940 1481 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Bootstrap starting.
I20260812 11:18:27.670599 1483 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Bootstrap starting.
I20260812 11:18:27.674829 1481 tablet_bootstrap.cc:654] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:27.675959 1484 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Bootstrap starting.
I20260812 11:18:27.676308 1483 tablet_bootstrap.cc:654] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:27.677708 1483 log.cc:824] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:27.677750 1481 log.cc:824] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:27.681607 1483 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: No bootstrap required, opened a new log
I20260812 11:18:27.681911 1483 ts_tablet_manager.cc:1397] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260812 11:18:27.682010 1481 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: No bootstrap required, opened a new log
I20260812 11:18:27.682315 1481 ts_tablet_manager.cc:1397] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.002s
I20260812 11:18:27.682739 1484 tablet_bootstrap.cc:654] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Neither blocks nor log segments found. Creating new log.
I20260812 11:18:27.684185 1484 log.cc:824] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:18:27.687822 1484 tablet_bootstrap.cc:492] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: No bootstrap required, opened a new log
I20260812 11:18:27.688133 1484 ts_tablet_manager.cc:1397] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260812 11:18:27.690368 1483 raft_consensus.cc:348] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.690838 1483 raft_consensus.cc:374] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:27.690939 1483 raft_consensus.cc:729] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3dd75dbfcce400280c42ac06639166b, State: Initialized, Role: FOLLOWER
I20260812 11:18:27.691592 1483 consensus_queue.cc:260] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.692802 1214 heartbeater.cc:503] Master 127.15.164.254:43139 was elected leader, sending a full tablet report...
I20260812 11:18:27.693295 1483 ts_tablet_manager.cc:1428] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260812 11:18:27.694775 1481 raft_consensus.cc:348] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.695261 1481 raft_consensus.cc:374] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:27.695382 1481 raft_consensus.cc:729] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1a4d5c2b1164fd588c72dd5b76bd778, State: Initialized, Role: FOLLOWER
I20260812 11:18:27.696046 1481 consensus_queue.cc:260] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.698110 1481 ts_tablet_manager.cc:1428] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260812 11:18:27.700835 1484 raft_consensus.cc:348] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.701318 1484 raft_consensus.cc:374] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:18:27.701433 1484 raft_consensus.cc:729] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d9267befd94085b4578304137892f6, State: Initialized, Role: FOLLOWER
I20260812 11:18:27.702095 1484 consensus_queue.cc:260] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.703457 1451 heartbeater.cc:503] Master 127.15.164.254:43139 was elected leader, sending a full tablet report...
I20260812 11:18:27.704002 1484 ts_tablet_manager.cc:1428] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260812 11:18:27.752167 1218 tablet.cc:2369] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:18:27.767248 1490 raft_consensus.cc:482] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:18:27.767629 1490 raft_consensus.cc:504] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.769754 1490 leader_election.cc:288] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1a4d5c2b1164fd588c72dd5b76bd778 (127.15.164.193:44543), d1d9267befd94085b4578304137892f6 (127.15.164.195:38179)
I20260812 11:18:27.778825 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.770884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:46901 (local address 127.15.164.193:44543)
0812 11:18:27.771198 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.771204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.771920 (+ 716us) server_negotiation.cc:407] Connection header received
0812 11:18:27.772165 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.772170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.772250 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.772360 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:18:27.773054 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.774101 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.776795 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.777697 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.777896 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.777988 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.778394 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.778556 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260812 11:18:27.778985 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.770299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:44543 (local address 127.15.164.194:46901)
0812 11:18:27.771799 (+ 1500us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.771816 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.771995 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.772392 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.772397 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.772425 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:18:27.772874 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.772886 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.774258 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.774264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.776624 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.776636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.777943 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.777951 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.778191 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.778233 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.778350 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.778552 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1396,"mutex_wait_us":22,"thread_start_us":732,"threads_started":1}
I20260812 11:18:27.779057 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.770424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:33187 (local address 127.15.164.195:38179)
0812 11:18:27.770650 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.770657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.771323 (+ 666us) server_negotiation.cc:407] Connection header received
0812 11:18:27.771638 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.771645 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.771733 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.771794 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:18:27.772637 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.773614 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.776563 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.777780 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.777938 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.778008 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.778604 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.778767 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:18:27.779840 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.770169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38179 (local address 127.15.164.194:33187)
0812 11:18:27.771204 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0812 11:18:27.771226 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:18:27.771461 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:18:27.772001 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:18:27.772006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:18:27.772033 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:18:27.772404 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.772416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.773763 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.773770 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.776384 (+ 2614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:18:27.776402 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.778169 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.778177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:18:27.778370 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.778400 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:18:27.779315 (+ 915us) client_negotiation.cc:240] Negotiation successful
0812 11:18:27.779453 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":82,"thread_start_us":1291,"threads_started":1}
I20260812 11:18:27.780313 917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7c8cfa9af14076940e1381b1649b46" candidate_uuid: "f3dd75dbfcce400280c42ac06639166b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" is_pre_election: true
I20260812 11:18:27.781000 917 raft_consensus.cc:2454] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3dd75dbfcce400280c42ac06639166b in term 0.
I20260812 11:18:27.780912 1370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7c8cfa9af14076940e1381b1649b46" candidate_uuid: "f3dd75dbfcce400280c42ac06639166b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d9267befd94085b4578304137892f6" is_pre_election: true
I20260812 11:18:27.781443 1370 raft_consensus.cc:2454] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3dd75dbfcce400280c42ac06639166b in term 0.
I20260812 11:18:27.781802 1030 leader_election.cc:302] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1a4d5c2b1164fd588c72dd5b76bd778, f3dd75dbfcce400280c42ac06639166b; no voters:
I20260812 11:18:27.782287 1490 raft_consensus.cc:2781] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:18:27.782447 1490 raft_consensus.cc:482] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:18:27.782581 1490 raft_consensus.cc:3037] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:27.785558 1490 raft_consensus.cc:504] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.786194 1490 leader_election.cc:288] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [CANDIDATE]: Term 1 election: Requested vote from peers f1a4d5c2b1164fd588c72dd5b76bd778 (127.15.164.193:44543), d1d9267befd94085b4578304137892f6 (127.15.164.195:38179)
I20260812 11:18:27.786748 1370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7c8cfa9af14076940e1381b1649b46" candidate_uuid: "f3dd75dbfcce400280c42ac06639166b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d9267befd94085b4578304137892f6"
I20260812 11:18:27.786748 917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e7c8cfa9af14076940e1381b1649b46" candidate_uuid: "f3dd75dbfcce400280c42ac06639166b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778"
I20260812 11:18:27.786952 917 raft_consensus.cc:3037] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:27.786963 1370 raft_consensus.cc:3037] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:18:27.789237 1370 raft_consensus.cc:2454] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3dd75dbfcce400280c42ac06639166b in term 1.
I20260812 11:18:27.789602 917 raft_consensus.cc:2454] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3dd75dbfcce400280c42ac06639166b in term 1.
I20260812 11:18:27.789672 1028 leader_election.cc:302] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d9267befd94085b4578304137892f6, f3dd75dbfcce400280c42ac06639166b; no voters:
I20260812 11:18:27.790006 1490 raft_consensus.cc:2781] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:18:27.790558 1490 raft_consensus.cc:686] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 1 LEADER]: Becoming Leader. State: Replica: f3dd75dbfcce400280c42ac06639166b, State: Running, Role: LEADER
I20260812 11:18:27.791158 1490 consensus_queue.cc:237] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } }
I20260812 11:18:27.796365 697 catalog_manager.cc:5495] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b reported cstate change: term changed from 0 to 1, leader changed from <none> to f3dd75dbfcce400280c42ac06639166b (127.15.164.194). New cstate: current_term: 1 leader_uuid: "f3dd75dbfcce400280c42ac06639166b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3dd75dbfcce400280c42ac06639166b" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 } health_report { overall_health: UNKNOWN } } }
W20260812 11:18:27.804180 1453 tablet.cc:2369] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:18:27.843724 1473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.837944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.15.164.194:37345)
0812 11:18:27.838140 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.838144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.838320 (+ 176us) server_negotiation.cc:407] Connection header received
0812 11:18:27.838561 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.838565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.838647 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.838784 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:18:27.839215 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.839964 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.841536 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.841940 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.842037 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.842612 (+ 575us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:18:27.843131 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:18:27.843248 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.843424 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.843494 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:18:27.852250 1370 raft_consensus.cc:1261] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 1 FOLLOWER]: Refusing update from remote peer f3dd75dbfcce400280c42ac06639166b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:18:27.852285 917 raft_consensus.cc:1261] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 1 FOLLOWER]: Refusing update from remote peer f3dd75dbfcce400280c42ac06639166b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:18:27.853374 1495 consensus_queue.cc:1035] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1a4d5c2b1164fd588c72dd5b76bd778" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:18:27.853781 1490 consensus_queue.cc:1035] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d9267befd94085b4578304137892f6" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:18:27.866626 1499 mvcc.cc:205] Tried to move back new op lower bound from 7317641248152190976 to 7317641247917576192. Current Snapshot: MvccSnapshot[applied={T|T < 7317641248152190976}]
I20260812 11:18:27.883095 697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:18:27.883402 697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:18:27.887456 697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b52e5393371458481178da607fb5824: Sending DeleteTablet for 3 replicas of tablet 3e7c8cfa9af14076940e1381b1649b46
I20260812 11:18:27.888936 1103 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:18:27 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58870
I20260812 11:18:27.888988 1340 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:18:27 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:40982
I20260812 11:18:27.888931 882 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e7c8cfa9af14076940e1381b1649b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:18:27 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59550
I20260812 11:18:27.892961 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 783
I20260812 11:18:27.900208 1518 tablet_replica.cc:330] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: stopping tablet replica
I20260812 11:18:27.900746 1518 raft_consensus.cc:2229] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:18:27.901338 1518 raft_consensus.cc:2258] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:18:27.902364 1514 tablet_replica.cc:330] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: stopping tablet replica
I20260812 11:18:27.902837 1514 raft_consensus.cc:2229] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:18:27.903355 1514 raft_consensus.cc:2258] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:18:27.905341 1518 ts_tablet_manager.cc:1905] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:18:27.908880 1514 ts_tablet_manager.cc:1905] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:18:27.910657 1516 tablet_replica.cc:330] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: stopping tablet replica
I20260812 11:18:27.911123 1516 raft_consensus.cc:2229] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:18:27.911882 1516 raft_consensus.cc:2258] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:18:27.915355 1516 ts_tablet_manager.cc:1905] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:18:27.916793 1514 ts_tablet_manager.cc:1918] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:18:27.917469 1514 log.cc:1196] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/3e7c8cfa9af14076940e1381b1649b46
I20260812 11:18:27.918162 1514 ts_tablet_manager.cc:1939] T 3e7c8cfa9af14076940e1381b1649b46 P d1d9267befd94085b4578304137892f6: Deleting consensus metadata
I20260812 11:18:27.920504 677 catalog_manager.cc:4841] TS d1d9267befd94085b4578304137892f6 (127.15.164.195:38179): tablet 3e7c8cfa9af14076940e1381b1649b46 (table test-table [id=46863cec3d154a6f8851834a3441da31]) successfully deleted
Aug 12 11:18:27 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:18:27.924237 1516 ts_tablet_manager.cc:1918] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:18:27.924288 1518 ts_tablet_manager.cc:1918] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:18:27.924427 1516 log.cc:1196] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/3e7c8cfa9af14076940e1381b1649b46
I20260812 11:18:27.925004 1516 ts_tablet_manager.cc:1939] T 3e7c8cfa9af14076940e1381b1649b46 P f3dd75dbfcce400280c42ac06639166b: Deleting consensus metadata
I20260812 11:18:27.926041 1518 log.cc:1196] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/3e7c8cfa9af14076940e1381b1649b46
I20260812 11:18:27.926720 1518 ts_tablet_manager.cc:1939] T 3e7c8cfa9af14076940e1381b1649b46 P f1a4d5c2b1164fd588c72dd5b76bd778: Deleting consensus metadata
I20260812 11:18:27.926959 678 catalog_manager.cc:4841] TS f3dd75dbfcce400280c42ac06639166b (127.15.164.194:37345): tablet 3e7c8cfa9af14076940e1381b1649b46 (table test-table [id=46863cec3d154a6f8851834a3441da31]) successfully deleted
I20260812 11:18:27.928755 678 catalog_manager.cc:4841] TS f1a4d5c2b1164fd588c72dd5b76bd778 (127.15.164.193:44543): tablet 3e7c8cfa9af14076940e1381b1649b46 (table test-table [id=46863cec3d154a6f8851834a3441da31]) successfully deleted
I20260812 11:18:27.929906 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:27.895488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59566 (local address 127.15.164.193:44543)
0812 11:18:27.895759 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:27.895766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:27.909907 (+ 14141us) server_negotiation.cc:407] Connection header received
0812 11:18:27.910112 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:27.910117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:27.910203 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:27.910327 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:27.912183 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.913321 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.915328 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:27.915971 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:27.916072 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:27.922519 (+ 6447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:27.922537 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:27.922558 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:27.922619 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:27.926713 (+ 4094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.927688 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.927699 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.927702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.927874 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:27.928381 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:27.928385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:27.928388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:27.928906 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:27.929162 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:27.929470 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 11:18:27.929641 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 11:18:27.930626 980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:28.039357 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 783
I20260812 11:18:28.072760 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 995
Aug 12 11:18:28 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:18:28.093457 1473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:28.073718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.15.164.194:37345)
0812 11:18:28.073890 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:28.073895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:28.073915 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:18:28.074033 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:28.074037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:28.074101 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:28.074184 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:28.076134 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:28.076992 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:28.079098 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:28.079612 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:28.079727 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:28.085270 (+ 5543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:28.085286 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:28.085308 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:28.085378 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:28.090224 (+ 4846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:28.091118 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:28.091129 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:28.091133 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:28.091336 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:28.091707 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:28.091713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:28.091717 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:28.092216 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:28.092575 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:28.092776 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 11:18:28.093032 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:18:28.094347 1204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:28.210896 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 995
I20260812 11:18:28.239076 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 1224
Aug 12 11:18:28 dist-test-slave-7kzw krb5kdc[618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:18:28.255267 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:18:28.239915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.15.164.195:38179)
0812 11:18:28.240104 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:18:28.240109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:18:28.240139 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:18:28.240284 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:18:28.240289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:18:28.240365 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:18:28.240466 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:18:28.241813 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:28.242676 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:28.243938 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:18:28.244379 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:18:28.244497 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:18:28.249001 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:18:28.249018 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:18:28.249036 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:18:28.249072 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:18:28.251895 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:28.252612 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:28.252621 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:28.252625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:28.252797 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:18:28.253226 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:18:28.253234 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:18:28.253239 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:18:28.253619 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:18:28.253875 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 11:18:28.254394 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 11:18:28.254793 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:18:28.256160 1444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:28.350095 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 1224
I20260812 11:18:28.385583 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 646
I20260812 11:18:28.386982 742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:18:28.497066 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 646
2026-08-12T11:18:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4907 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:18:28 dist-test-slave-7kzw krb5kdc[1532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:18:28 dist-test-slave-7kzw krb5kdc[1532](info): set up 2 sockets
Aug 12 11:18:28 dist-test-slave-7kzw krb5kdc[1532](info): commencing operation
krb5kdc: starting...
W20260812 11:18:29.860482 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:18:30 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:18:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:18:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangeradmin_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangeradmin_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangerlookup_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangerlookup_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
I20260812 11:18:30.291636 16019 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskghXBKM/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/postgres -l logfile start
2026-08-12 11:18:33.102 UTC [1583] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:18:33.102 UTC [1583] LOG: listening on IPv4 address "127.15.164.212", port 55193
2026-08-12 11:18:33.106 UTC [1583] LOG: listening on Unix socket "/tmp/.s.PGSQL.55193"
2026-08-12 11:18:33.130 UTC [1588] LOG: database system was shut down at 2026-08-12 11:18:31 UTC
2026-08-12 11:18:33.135 UTC [1583] LOG: database system is ready to accept connections
I20260812 11:18:34.356814 16019 mini_postgres.cc:96] Postgres bound to 55193
2026-08-12 11:18:34.381 UTC [1600] FATAL: database "slave" does not exist
127.15.164.212:55193 - accepting connections
I20260812 11:18:34.382055 16019 mini_ranger.cc:161] Starting Ranger...
I20260812 11:18:34.418627 16019 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:18:35.010774 16019 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:18:35.010932 16019 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin
2026-08-12 11:18:35,344 [I] DB FLAVOR :POSTGRES
2026-08-12 11:18:35,345 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:18:35,345 [I] Checking connection..
2026-08-12 11:18:35,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:18:35,623 [I] Checking connection passed.
2026-08-12 11:18:35,624 [I] --------- Verifying version history table ---------
2026-08-12 11:18:35,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:18:35,908 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:18:35,908 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:18:36,195 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:18:36,195 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:18:36,195 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:18:36.443 UTC [1697] WARNING: there is no transaction in progress
2026-08-12 11:18:36,452 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:18:36,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:18:36,717 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:18:36,717 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:18:36,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:18:36,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:18:37,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7kzw.c.gcp-upstream.internal','N') ;"
2026-08-12 11:18:37,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:18:37,807 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:18:37,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:18:38,070 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:18:38,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:18:38,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:18:38,578 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:18:38,578 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:18:39.649 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.667 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.686 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.702 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.719 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.740 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.800 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.808 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.825 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.837 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.850 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.865 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.876 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.884 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.892 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:39.903 UTC [1876] WARNING: there is no transaction in progress
2026-08-12 11:18:40,637 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:18:40,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:18:40,878 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:18:40,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:18:41,154 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:18:41,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:18:41,452 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:18:41,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:18:41,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:18:41,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7kzw.c.gcp-upstream.internal';"
2026-08-12 11:18:42,246 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:18:42,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:18:42,518 [I] DB_PATCHES have already been applied
I20260812 11:18:42.525041 16019 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskghXBKM/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:18:42.525153 16019 mini_ranger.cc:193] Using host: 127.15.164.212
I20260812 11:18:42.546669 16019 mini_ranger.cc:227] Ranger admin URL: http://127.15.164.212:60353
Aug 12, 2026 11:18:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:18:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:18:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:18:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:18:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:18:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:18:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:18:44.019155 16019 mini_ranger.cc:160] Time spent starting Ranger: real 9.637s user 0.000s sys 0.064s
Aug 12, 2026 11:19:04 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:19:05 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 11:19:05 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:19:05 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:19:06 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:19:06.604388 16019 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangerkms_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/rangerkms_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.164.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.164.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:19:06 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533546, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:19:06.816480 16019 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:19:06.843945 16019 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:19:07.804476 16019 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:19:07.804617 16019 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms
I20260812 11:19:07.804773 16019 mini_ranger_kms.cc:227] Using postgres at 127.15.164.212:55193
2026-08-12 11:19:08,485 [I] DB FLAVOR :POSTGRES
2026-08-12 11:19:08,486 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:19:08,486 [I] Checking connection
2026-08-12 11:19:08,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:19:08,737 [I] connection success
2026-08-12 11:19:08,737 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:19:08,737 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:19:08,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:19:08,985 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:19:08,985 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:19:08,985 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:19:08,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:55193/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:19:09,281 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:19:09.787927 16019 mini_ranger_kms.cc:310] Created kms service
I20260812 11:19:09.961442 16019 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:19:10.010121 16019 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:19:10 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533546, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:10.435451 16019 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:19:10.437006 16019 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms:/tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:19:10.437098 16019 mini_ranger_kms.cc:240] Using host: 127.15.164.212
I20260812 11:19:10.467514 16019 mini_ranger_kms.cc:276] Ranger KMS PID: 2156
I20260812 11:19:10.467765 16019 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.164.212:50631
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:19:12 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533552, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 11:19:13 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533552, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:13.401737 16019 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.585s user 0.127s sys 0.416s
I20260812 11:19:13.402135 16019 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:19:13.402364 16019 mini_ranger_kms.cc:401] 127.15.164.212:50631/kms/v1/keys
Aug 12 11:19:13 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533552, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
Aug 12 11:19:16 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:19:16.279266 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39599
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:39599
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:50631/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:19:16.657320 2230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:19:16.657655 2230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:19:16.657809 2230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:19:16.665534 2230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:19:16.665661 2230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:19:16.665740 2230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:19:16.665854 2230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:19:16.665923 2230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:19:16.676831 2230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.164.212:50631/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:39599
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:39599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:19:16.678223 2230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:19:16.679675 2230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:19:16.692854 2237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:16.692898 2238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:16.692955 2240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:19:16.693212 2230 server_base.cc:1034] running on GCE node
I20260812 11:19:16.694356 2230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:19:16.695792 2230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:19:16.697039 2230 hybrid_clock.cc:648] HybridClock initialized: now 1786533556696981 us; error 46 us; skew 500 ppm
I20260812 11:19:16.697404 2230 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:19:16 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:19:16.700762 2230 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:19:16.702425 2230 webserver.cc:460] Webserver started at http://127.15.164.254:33305/ using document root <none> and password file <none>
I20260812 11:19:16.703209 2230 fs_manager.cc:359] Metadata directory not provided
I20260812 11:19:16.703318 2230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:19:16.703583 2230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:19:16 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:16.776369 2230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "8b83ecee07f44f46a3b89fae8df97423"
format_stamp: "Formatted at 2026-08-12 11:19:16 on dist-test-slave-7kzw"
server_key: "b306213d24c9a0f7f1f9a4c7c4e4da60"
server_key_iv: "b4e0a9e2fa512b6b1d3ed35b4d4c07b5"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:16.777287 2230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "8b83ecee07f44f46a3b89fae8df97423"
format_stamp: "Formatted at 2026-08-12 11:19:16 on dist-test-slave-7kzw"
server_key: "b306213d24c9a0f7f1f9a4c7c4e4da60"
server_key_iv: "b4e0a9e2fa512b6b1d3ed35b4d4c07b5"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:16.783344 2230 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:19:16.800539 2251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:16.802220 2230 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260812 11:19:16.802497 2230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "8b83ecee07f44f46a3b89fae8df97423"
format_stamp: "Formatted at 2026-08-12 11:19:16 on dist-test-slave-7kzw"
server_key: "b306213d24c9a0f7f1f9a4c7c4e4da60"
server_key_iv: "b4e0a9e2fa512b6b1d3ed35b4d4c07b5"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:16.802736 2230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:19:16.826299 2230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:19:16.830660 2230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:19:16.830991 2230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:19:16.852556 2230 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:39599
I20260812 11:19:16.852576 2327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:39599 every 8 connection(s)
I20260812 11:19:16.854059 2230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:19:16.858250 2328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:19:16.863461 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 2230
I20260812 11:19:16.863680 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:19:16.864490 16019 external_mini_cluster.cc:1428] Setting key 992c0b170ee38adddbd38eedeecef04a
I20260812 11:19:16.872893 2328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: Bootstrap starting.
I20260812 11:19:16.878399 2328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: Neither blocks nor log segments found. Creating new log.
I20260812 11:19:16.880438 2328 log.cc:824] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: Log is configured to *not* fsync() on all Append() calls
I20260812 11:19:16.884232 2328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: No bootstrap required, opened a new log
I20260812 11:19:16.893857 2328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } }
I20260812 11:19:16.894375 2328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:19:16.894541 2328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b83ecee07f44f46a3b89fae8df97423, State: Initialized, Role: FOLLOWER
I20260812 11:19:16.895328 2328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } }
I20260812 11:19:16.895661 2328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:19:16.895874 2328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:19:16.896068 2328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 11:19:16 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:19:16.898442 2328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } }
I20260812 11:19:16.899114 2328 leader_election.cc:302] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b83ecee07f44f46a3b89fae8df97423; no voters:
I20260812 11:19:16.899786 2328 leader_election.cc:288] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:19:16.899957 2334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:19:16.902122 2328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:19:16.902493 2334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [term 1 LEADER]: Becoming Leader. State: Replica: 8b83ecee07f44f46a3b89fae8df97423, State: Running, Role: LEADER
I20260812 11:19:16.903179 2334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } }
I20260812 11:19:16.909163 2331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:16.866877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52974 (local address 127.15.164.254:39599)
0812 11:19:16.881561 (+ 14684us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:16.881582 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:16.881638 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:19:16.884271 (+ 2633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:16.884302 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:16.884822 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:16.885279 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:16.887012 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:16.889294 (+ 2282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:16.891208 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:16.892325 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:16.892515 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:16.897416 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:16.897424 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:16.897439 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:16.897494 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:16.902006 (+ 4512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:16.902967 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:16.902976 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:16.902984 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:16.903199 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:16.903675 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:16.903680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:16.903683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:16.904490 (+ 807us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:16.904832 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:16.906556 (+ 1724us) server_negotiation.cc:299] Negotiation successful
0812 11:19:16.907307 (+ 751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14394,"thread_start_us":14750,"threads_started":1}
I20260812 11:19:16.909602 2337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b83ecee07f44f46a3b89fae8df97423" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } } }
I20260812 11:19:16.909974 2337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [sys.catalog]: This master's current role is: LEADER
I20260812 11:19:16.913645 2340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b83ecee07f44f46a3b89fae8df97423. Latest consensus state: current_term: 1 leader_uuid: "8b83ecee07f44f46a3b89fae8df97423" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b83ecee07f44f46a3b89fae8df97423" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 39599 } } }
I20260812 11:19:16.913949 2340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423 [sys.catalog]: This master's current role is: LEADER
I20260812 11:19:16.915532 2361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:19:16.915872 2328 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:19:16.930537 2361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:19:16.955107 2361 catalog_manager.cc:1347] Generated new cluster ID: 5dcf2ba6a6ef4e49b8fae55817722f41
I20260812 11:19:16.955263 2361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:19:16.992410 2361 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:19:16.994526 2361 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:19:17.003633 2361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: Generated new TSK 0
I20260812 11:19:17.004802 2361 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:19:17.794838 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:50631/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:19:18 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:19:18.306687 2402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:19:18.307219 2402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:19:18.307438 2402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:19:18.316346 2402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:19:18.316469 2402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:19:18.316668 2402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:19:18.326952 2402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.164.212:50631/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:19:18.328469 2402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:19:18.329952 2402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:19:18.356848 2414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:18.356865 2415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:18.364411 2419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:19:18.365585 2402 server_base.cc:1034] running on GCE node
I20260812 11:19:18.366484 2402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:19:18.367956 2402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:19:18.369282 2402 hybrid_clock.cc:648] HybridClock initialized: now 1786533558369205 us; error 54 us; skew 500 ppm
I20260812 11:19:18.369704 2402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:19:18 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:19:18.374533 2402 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:19:18.393442 2402 webserver.cc:460] Webserver started at http://127.15.164.193:36785/ using document root <none> and password file <none>
I20260812 11:19:18.394578 2402 fs_manager.cc:359] Metadata directory not provided
I20260812 11:19:18.394739 2402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:19:18.395140 2402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:19:18 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:18.419891 2402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "cd18698ff92e4d208f4a807f44e8f63f"
format_stamp: "Formatted at 2026-08-12 11:19:18 on dist-test-slave-7kzw"
server_key: "c6092cbfd191b8650cdb1c53dfd43963"
server_key_iv: "0bf0ede01a3d044a503be7c123650fac"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:18.422528 2402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "cd18698ff92e4d208f4a807f44e8f63f"
format_stamp: "Formatted at 2026-08-12 11:19:18 on dist-test-slave-7kzw"
server_key: "c6092cbfd191b8650cdb1c53dfd43963"
server_key_iv: "0bf0ede01a3d044a503be7c123650fac"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:18.431399 2402 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260812 11:19:18.467228 2433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:18.469391 2402 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.011s sys 0.008s
I20260812 11:19:18.469683 2402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "cd18698ff92e4d208f4a807f44e8f63f"
format_stamp: "Formatted at 2026-08-12 11:19:18 on dist-test-slave-7kzw"
server_key: "c6092cbfd191b8650cdb1c53dfd43963"
server_key_iv: "0bf0ede01a3d044a503be7c123650fac"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:18.470052 2402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:19:18.523911 2402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:19:18.529464 2402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:19:18.529910 2402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:19:18.537329 2402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:19:18.545584 2402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:19:18.545789 2402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:19:18.546005 2402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:19:18.546129 2402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:19:18 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
Aug 12 11:19:18 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:19.157980 2601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:35461 every 8 connection(s)
I20260812 11:19:19.158607 2402 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:35461
I20260812 11:19:19.160832 2402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:19:19.171195 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 2402
I20260812 11:19:19.171437 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:19:19.172353 16019 external_mini_cluster.cc:1428] Setting key ec230695fbbb924f26f13679f5fe1349
Aug 12 11:19:19 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533558, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
I20260812 11:19:19.227147 2607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:19.175780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39599 (local address 127.15.164.193:41009)
0812 11:19:19.179161 (+ 3381us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:19.179220 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:19.182378 (+ 3158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:19.201017 (+ 18639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:19.201037 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:19.201898 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:19:19.202975 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:19.203011 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.205315 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.205325 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:19.208014 (+ 2689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:19.208039 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.209651 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.209663 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:19.210083 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:19.211150 (+ 1067us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:19:19.211190 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:19:19.214570 (+ 3380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:19:19.219826 (+ 5256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:19.219840 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:19.219865 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:19.220684 (+ 819us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:19.222495 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:19.222502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:19.222506 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:19.222913 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:19.223820 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:19:19.223831 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:19:19.224395 (+ 564us) client_negotiation.cc:769] Sending connection context
0812 11:19:19.224776 (+ 381us) client_negotiation.cc:240] Negotiation successful
0812 11:19:19.225420 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3032,"thread_start_us":2738,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
I20260812 11:19:19.228838 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:19.173286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41009 (local address 127.15.164.254:39599)
0812 11:19:19.200111 (+ 26825us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:19.200127 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:19.200174 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:19:19.200265 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:19.200270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:19.200368 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:19.200547 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:19.203833 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.205042 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.208260 (+ 3218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.209095 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.209251 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:19.215175 (+ 5924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:19.215185 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:19.215193 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:19.215246 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:19.219552 (+ 4306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:19.222055 (+ 2503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:19.222063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:19.222067 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:19.222280 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:19.223098 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:19.223104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:19.223107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:19.223557 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:19.223727 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:19.227908 (+ 4181us) server_negotiation.cc:299] Negotiation successful
0812 11:19:19.228363 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26649,"thread_start_us":27410,"threads_started":1}
I20260812 11:19:19.236409 2602 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39599
I20260812 11:19:19.236847 2602 heartbeater.cc:464] Registering TS with master...
I20260812 11:19:19.237905 2602 heartbeater.cc:511] Master 127.15.164.254:39599 requested a full tablet report, sending...
I20260812 11:19:19.240854 2275 ts_manager.cc:194] Registered new tserver with Master: cd18698ff92e4d208f4a807f44e8f63f (127.15.164.193:35461)
I20260812 11:19:19.243234 2275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:41009
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:19:19.273027 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:50631/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:19:19.669560 2615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:19:19.669915 2615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:19:19.670030 2615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:19:19.678854 2615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:19:19.678988 2615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:19:19.679111 2615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:19:19.689680 2615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.164.212:50631/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:19:19.691107 2615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:19:19.692390 2615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:19:19.706962 2630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:19.707114 2631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:19.707746 2633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:19:19.708794 2615 server_base.cc:1034] running on GCE node
I20260812 11:19:19.709506 2615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:19:19.710680 2615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:19:19.712009 2615 hybrid_clock.cc:648] HybridClock initialized: now 1786533559711935 us; error 65 us; skew 500 ppm
I20260812 11:19:19.712579 2615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:19:19 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533559, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:19:19.716432 2615 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:19:19.718204 2615 webserver.cc:460] Webserver started at http://127.15.164.194:43667/ using document root <none> and password file <none>
I20260812 11:19:19.719177 2615 fs_manager.cc:359] Metadata directory not provided
I20260812 11:19:19.719340 2615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:19:19.719686 2615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:19:19 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533559, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:19.737836 2615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "6178831f5caf402fb386b5678013cbcc"
format_stamp: "Formatted at 2026-08-12 11:19:19 on dist-test-slave-7kzw"
server_key: "c9573a04372e38fc71dc1f0b93df3878"
server_key_iv: "2337c9afc8d943b661ff2b358e654a45"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:19.738946 2615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "6178831f5caf402fb386b5678013cbcc"
format_stamp: "Formatted at 2026-08-12 11:19:19 on dist-test-slave-7kzw"
server_key: "c9573a04372e38fc71dc1f0b93df3878"
server_key_iv: "2337c9afc8d943b661ff2b358e654a45"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:19.745817 2615 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:19:19.764974 2641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:19.766948 2615 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:19:19.767185 2615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "6178831f5caf402fb386b5678013cbcc"
format_stamp: "Formatted at 2026-08-12 11:19:19 on dist-test-slave-7kzw"
server_key: "c9573a04372e38fc71dc1f0b93df3878"
server_key_iv: "2337c9afc8d943b661ff2b358e654a45"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:19.767468 2615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:19:19.797978 2615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:19:19.802800 2615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:19:19.803229 2615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:19:19.804440 2615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:19:19.806296 2615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:19:19.806389 2615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:19.806566 2615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:19:19.806627 2615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:19.846554 2615 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:38329
I20260812 11:19:19.846652 2807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:38329 every 8 connection(s)
I20260812 11:19:19.847972 2615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:19:19.851874 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 2615
I20260812 11:19:19.852099 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:19:19.852697 16019 external_mini_cluster.cc:1428] Setting key e37d102e1d0412d65bf63521b9f51252
Aug 12 11:19:19 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533559, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:19:19.875602 2814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:19.850861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:43249 (local address 127.15.164.254:39599)
0812 11:19:19.851363 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:19.851370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:19.853119 (+ 1749us) server_negotiation.cc:407] Connection header received
0812 11:19:19.855364 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:19.855370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:19.855466 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:19.855593 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:19.857466 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.858815 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.861261 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.862116 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.862268 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:19.866879 (+ 4611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:19.866886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:19.866890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:19.866940 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:19.871783 (+ 4843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:19.872862 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:19.872869 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:19.872873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:19.873029 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:19.873518 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:19.873524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:19.873528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:19.873858 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:19.874028 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:19.874917 (+ 889us) server_negotiation.cc:299] Negotiation successful
0812 11:19:19.875191 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":226,"threads_started":1}
I20260812 11:19:19.876796 2816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:19.851508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39599 (local address 127.15.164.194:43249)
0812 11:19:19.852581 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:19.852650 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:19.855059 (+ 2409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:19.855835 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:19.855846 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:19.856472 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:19:19.857259 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:19.857288 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.859014 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.859021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:19.861073 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:19.861090 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:19.862388 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:19.862398 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:19.862729 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:19.863526 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:19:19.863557 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:19:19.866448 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:19:19.872010 (+ 5562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:19.872020 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:19.872039 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:19.872581 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:19.873166 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:19.873171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:19.873177 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:19.873388 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:19.874001 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:19:19.874012 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:19:19.874411 (+ 399us) client_negotiation.cc:769] Sending connection context
0812 11:19:19.874802 (+ 391us) client_negotiation.cc:240] Negotiation successful
0812 11:19:19.875456 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":494,"threads_started":1}
I20260812 11:19:19.878720 2809 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39599
I20260812 11:19:19.879129 2809 heartbeater.cc:464] Registering TS with master...
I20260812 11:19:19.880065 2809 heartbeater.cc:511] Master 127.15.164.254:39599 requested a full tablet report, sending...
I20260812 11:19:19.881966 2275 ts_manager.cc:194] Registered new tserver with Master: 6178831f5caf402fb386b5678013cbcc (127.15.164.194:38329)
I20260812 11:19:19.883076 2275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:43249
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:19:19.922636 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:50631/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:19:20.247843 2602 heartbeater.cc:503] Master 127.15.164.254:39599 was elected leader, sending a full tablet report...
W20260812 11:19:20.303243 2822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:19:20.303588 2822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:19:20.303779 2822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:19:20.311722 2822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:19:20.311868 2822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:19:20.311986 2822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:19:20.322531 2822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.164.212:50631/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:39599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:19:20.323913 2822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:19:20.325755 2822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:19:20.340050 2830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:20.340145 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:19:20.340142 2827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:19:20.341250 2822 server_base.cc:1034] running on GCE node
I20260812 11:19:20.342079 2822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:19:20.343348 2822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:19:20.344622 2822 hybrid_clock.cc:648] HybridClock initialized: now 1786533560344541 us; error 71 us; skew 500 ppm
I20260812 11:19:20.345045 2822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:19:20 dist-test-slave-7kzw krb5kdc[1532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533560, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:19:20.348953 2822 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:19:20.350826 2822 webserver.cc:460] Webserver started at http://127.15.164.195:40535/ using document root <none> and password file <none>
I20260812 11:19:20.351585 2822 fs_manager.cc:359] Metadata directory not provided
I20260812 11:19:20.351747 2822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:19:20.352090 2822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:19:20 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533560, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:19:20.367251 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "9a56624fddf84bfd9b4a4954eae45ed7"
format_stamp: "Formatted at 2026-08-12 11:19:20 on dist-test-slave-7kzw"
server_key: "11424359c4d5d1a767c3214ed1812488"
server_key_iv: "20e0cf0322644c84f33a54842973ba40"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:20.368156 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "9a56624fddf84bfd9b4a4954eae45ed7"
format_stamp: "Formatted at 2026-08-12 11:19:20 on dist-test-slave-7kzw"
server_key: "11424359c4d5d1a767c3214ed1812488"
server_key_iv: "20e0cf0322644c84f33a54842973ba40"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:20.374755 2822 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 11:19:20.391494 2846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:20.393496 2822 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:19:20.393750 2822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "9a56624fddf84bfd9b4a4954eae45ed7"
format_stamp: "Formatted at 2026-08-12 11:19:20 on dist-test-slave-7kzw"
server_key: "11424359c4d5d1a767c3214ed1812488"
server_key_iv: "20e0cf0322644c84f33a54842973ba40"
server_key_version: "kuduclusterkey@0"
I20260812 11:19:20.394045 2822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:19:20.430538 2822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:19:20.435176 2822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:19:20.435478 2822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:19:20.436533 2822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:19:20.438046 2822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:19:20.438126 2822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:20.438222 2822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:19:20.438277 2822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:19:20.477339 2822 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:46045
I20260812 11:19:20.477399 3020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:46045 every 8 connection(s)
I20260812 11:19:20.478868 2822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:19:20.488566 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 2822
I20260812 11:19:20.488801 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:19:20.489332 16019 external_mini_cluster.cc:1428] Setting key 3b686973eefffb8d4de90b64fbab0ea2
Aug 12 11:19:20 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533560, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:19:20.508447 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.481893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:54609 (local address 127.15.164.254:39599)
0812 11:19:20.482595 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.482600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.483525 (+ 925us) server_negotiation.cc:407] Connection header received
0812 11:19:20.485601 (+ 2076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.485608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.485705 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.485847 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:20.487611 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.488656 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.490870 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.491377 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.491545 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.500718 (+ 9173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:20.500724 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:20.500728 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:20.500771 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:20.504281 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.505491 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.505502 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.505505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.505663 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.506244 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.506251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.506256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.506644 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:20.506792 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.507846 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.508075 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":337,"threads_started":1}
I20260812 11:19:20.509336 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.482429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:39599 (local address 127.15.164.195:54609)
0812 11:19:20.483334 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.483390 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.485267 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.486131 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.486140 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.486723 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:19:20.487394 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.487416 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.488939 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.488946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.490665 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.490681 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.491671 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.491683 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.491953 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.497854 (+ 5901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:19:20.497884 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:19:20.500314 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:19:20.504492 (+ 4178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:20.504505 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:20.504537 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:20.505341 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:20.505804 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:19:20.505810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:19:20.505814 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:19:20.506033 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:19:20.506804 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:19:20.506812 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:19:20.507319 (+ 507us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.507700 (+ 381us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.508164 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":330,"threads_started":1}
I20260812 11:19:20.510895 3021 heartbeater.cc:347] Connected to a master server at 127.15.164.254:39599
I20260812 11:19:20.511304 3021 heartbeater.cc:464] Registering TS with master...
I20260812 11:19:20.512212 3021 heartbeater.cc:511] Master 127.15.164.254:39599 requested a full tablet report, sending...
I20260812 11:19:20.514068 2275 ts_manager.cc:194] Registered new tserver with Master: 9a56624fddf84bfd9b4a4954eae45ed7 (127.15.164.195:46045)
I20260812 11:19:20.515120 2275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:54609
I20260812 11:19:20.519091 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:19:20.537792 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.523851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52986 (local address 127.15.164.254:39599)
0812 11:19:20.524064 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.524073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.524495 (+ 422us) server_negotiation.cc:407] Connection header received
0812 11:19:20.524729 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.524733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.524813 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.524922 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:20.526443 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.527410 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.528837 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.529279 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.529423 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.532083 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:20.532088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:20.532092 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:20.532127 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:20.534953 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.535672 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.535679 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.535682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.535866 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.536263 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.536272 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.536275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.536573 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:20.536869 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.537193 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.537452 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:19:20.543080 2275 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:19:20.550581 2275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:19:20.591490 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.565576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47242 (local address 127.15.164.193:35461)
0812 11:19:20.581055 (+ 15479us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.581065 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.581513 (+ 448us) server_negotiation.cc:407] Connection header received
0812 11:19:20.581642 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.581652 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.581952 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.582984 (+ 1032us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:19:20.583247 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.584964 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.588944 (+ 3980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.590076 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.590332 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.590577 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.590888 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.591088 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15271,"thread_start_us":15489,"threads_started":1}
I20260812 11:19:20.591714 3045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.564814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:35461 (local address 127.0.0.1:47242)
0812 11:19:20.581172 (+ 16358us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.581195 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.581344 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.582223 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.582230 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.582260 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:19:20.582952 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.582971 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.586607 (+ 3636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.586611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.588694 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.588710 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.590332 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.590339 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.590607 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.590672 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.590819 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.591130 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16235,"mutex_wait_us":61,"spinlock_wait_cycles":13696,"thread_start_us":14958,"threads_started":1}
I20260812 11:19:20.592092 3042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.564716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38329 (local address 127.0.0.1:58660)
0812 11:19:20.580193 (+ 15477us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.580242 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.580447 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.582432 (+ 1985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.582439 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.582527 (+ 88us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:19:20.583159 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.583172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.585314 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.585322 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.587949 (+ 2627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.587966 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.590504 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.590513 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.590725 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.590759 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.590832 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.591128 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15197,"mutex_wait_us":118,"spinlock_wait_cycles":4864,"thread_start_us":16583,"threads_started":1}
I20260812 11:19:20.592412 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.581217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.15.164.195:46045)
0812 11:19:20.582063 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.582070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.583013 (+ 943us) server_negotiation.cc:407] Connection header received
0812 11:19:20.583131 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.583140 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.583388 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.583605 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:19:20.584335 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.585689 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.588465 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.590397 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.590674 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.590858 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.591835 (+ 977us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.592006 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":489,"threads_started":1}
I20260812 11:19:20.592622 3049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.581072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:46045 (local address 127.0.0.1:46500)
0812 11:19:20.582699 (+ 1627us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.582729 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.582870 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.583691 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.583698 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.583733 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:19:20.584130 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.584146 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.585846 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.585851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.588269 (+ 2418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.588283 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.591027 (+ 2744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.591033 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.591220 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.591259 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.591364 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.591500 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1479,"mutex_wait_us":40,"thread_start_us":1658,"threads_started":1}
I20260812 11:19:20.593984 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.564840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58660 (local address 127.15.164.194:38329)
0812 11:19:20.579588 (+ 14748us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.579603 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.580350 (+ 747us) server_negotiation.cc:407] Connection header received
0812 11:19:20.580818 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.580826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.582165 (+ 1339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.583367 (+ 1202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:19:20.583656 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.585122 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.588176 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.590174 (+ 1998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.593115 (+ 2941us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.593332 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.593412 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.593586 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14491,"thread_start_us":14340,"threads_started":1}
I20260812 11:19:20.596576 2498 tablet_service.cc:1467] Processing CreateTablet for tablet 007bccad5b1644a29dd41f621520cd79 (DEFAULT_TABLE table=test-table [id=c2a96f38807d4343b9deb6235b041627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:19:20.596565 2912 tablet_service.cc:1467] Processing CreateTablet for tablet 007bccad5b1644a29dd41f621520cd79 (DEFAULT_TABLE table=test-table [id=c2a96f38807d4343b9deb6235b041627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:19:20.597590 2715 tablet_service.cc:1467] Processing CreateTablet for tablet 007bccad5b1644a29dd41f621520cd79 (DEFAULT_TABLE table=test-table [id=c2a96f38807d4343b9deb6235b041627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:19:20.598150 2912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007bccad5b1644a29dd41f621520cd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:19:20.598016 2498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007bccad5b1644a29dd41f621520cd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:19:20.599004 2715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 007bccad5b1644a29dd41f621520cd79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:19:20.611750 3052 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Bootstrap starting.
I20260812 11:19:20.613973 3053 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Bootstrap starting.
I20260812 11:19:20.616227 3054 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Bootstrap starting.
I20260812 11:19:20.616429 3052 tablet_bootstrap.cc:654] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Neither blocks nor log segments found. Creating new log.
I20260812 11:19:20.617975 3052 log.cc:824] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:19:20.620296 3054 tablet_bootstrap.cc:654] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Neither blocks nor log segments found. Creating new log.
I20260812 11:19:20.621219 3053 tablet_bootstrap.cc:654] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Neither blocks nor log segments found. Creating new log.
I20260812 11:19:20.621814 3054 log.cc:824] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Log is configured to *not* fsync() on all Append() calls
I20260812 11:19:20.622009 3052 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: No bootstrap required, opened a new log
I20260812 11:19:20.622347 3052 ts_tablet_manager.cc:1397] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260812 11:19:20.622615 3053 log.cc:824] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:19:20.625648 3054 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: No bootstrap required, opened a new log
I20260812 11:19:20.625931 3053 tablet_bootstrap.cc:492] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: No bootstrap required, opened a new log
I20260812 11:19:20.625995 3054 ts_tablet_manager.cc:1397] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260812 11:19:20.626221 3053 ts_tablet_manager.cc:1397] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260812 11:19:20.631279 3052 raft_consensus.cc:348] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.631729 3052 raft_consensus.cc:374] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:19:20.631848 3052 raft_consensus.cc:729] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd18698ff92e4d208f4a807f44e8f63f, State: Initialized, Role: FOLLOWER
I20260812 11:19:20.632567 3052 consensus_queue.cc:260] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.634593 3052 ts_tablet_manager.cc:1428] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 11:19:20.637493 3053 raft_consensus.cc:348] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.637496 3054 raft_consensus.cc:348] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.638228 3053 raft_consensus.cc:374] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:19:20.638233 3054 raft_consensus.cc:374] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:19:20.638361 3054 raft_consensus.cc:729] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6178831f5caf402fb386b5678013cbcc, State: Initialized, Role: FOLLOWER
I20260812 11:19:20.638361 3053 raft_consensus.cc:729] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a56624fddf84bfd9b4a4954eae45ed7, State: Initialized, Role: FOLLOWER
I20260812 11:19:20.639204 3054 consensus_queue.cc:260] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.639197 3053 consensus_queue.cc:260] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.640563 2809 heartbeater.cc:503] Master 127.15.164.254:39599 was elected leader, sending a full tablet report...
I20260812 11:19:20.641038 3021 heartbeater.cc:503] Master 127.15.164.254:39599 was elected leader, sending a full tablet report...
I20260812 11:19:20.641613 3054 ts_tablet_manager.cc:1428] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260812 11:19:20.641759 3053 ts_tablet_manager.cc:1428] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260812 11:19:20.698170 3059 raft_consensus.cc:482] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:19:20.698506 3059 raft_consensus.cc:504] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.700459 3059 leader_election.cc:288] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6178831f5caf402fb386b5678013cbcc (127.15.164.194:38329), 9a56624fddf84bfd9b4a4954eae45ed7 (127.15.164.195:46045)
W20260812 11:19:20.703260 2604 tablet.cc:2369] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:19:20.709085 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.700718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:38329 (local address 127.15.164.193:42109)
0812 11:19:20.702015 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.702032 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.702178 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.702772 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.702776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.702806 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:19:20.703408 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.703424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.704680 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.704686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.706623 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.706656 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.708168 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.708176 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.708368 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.708409 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.708513 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.708667 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"mutex_wait_us":123,"thread_start_us":884,"threads_started":1}
I20260812 11:19:20.709092 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.701024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:42109 (local address 127.15.164.194:38329)
0812 11:19:20.701301 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.701310 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.702145 (+ 835us) server_negotiation.cc:407] Connection header received
0812 11:19:20.702355 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.702361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.702447 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.702587 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:19:20.703671 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.704527 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.706884 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.707946 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.708080 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.708135 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.708668 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.708810 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:19:20.709450 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.700985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35485 (local address 127.15.164.195:46045)
0812 11:19:20.701304 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.701314 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.702601 (+ 1287us) server_negotiation.cc:407] Connection header received
0812 11:19:20.702898 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.702902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.702966 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.703103 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:19:20.703990 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.704937 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.707152 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.708284 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.708447 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.708538 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.709071 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.709221 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260812 11:19:20.709540 3067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.700787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:46045 (local address 127.15.164.193:35485)
0812 11:19:20.702493 (+ 1706us) negotiation.cc:107] Waiting for socket to connect
0812 11:19:20.702517 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:19:20.702708 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:19:20.703123 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:19:20.703127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:19:20.703155 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:19:20.703792 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.703808 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.705127 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.705132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.706990 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:19:20.707007 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.708677 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.708684 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:19:20.708865 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.708903 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:19:20.709005 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:19:20.709185 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1554,"thread_start_us":816,"threads_started":1}
I20260812 11:19:20.710724 2744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007bccad5b1644a29dd41f621520cd79" candidate_uuid: "cd18698ff92e4d208f4a807f44e8f63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6178831f5caf402fb386b5678013cbcc" is_pre_election: true
I20260812 11:19:20.710723 2949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007bccad5b1644a29dd41f621520cd79" candidate_uuid: "cd18698ff92e4d208f4a807f44e8f63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" is_pre_election: true
I20260812 11:19:20.711359 2744 raft_consensus.cc:2454] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd18698ff92e4d208f4a807f44e8f63f in term 0.
I20260812 11:19:20.711357 2949 raft_consensus.cc:2454] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd18698ff92e4d208f4a807f44e8f63f in term 0.
I20260812 11:19:20.712220 2436 leader_election.cc:302] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a56624fddf84bfd9b4a4954eae45ed7, cd18698ff92e4d208f4a807f44e8f63f; no voters:
I20260812 11:19:20.712782 3059 raft_consensus.cc:2781] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:19:20.712965 3059 raft_consensus.cc:482] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:19:20.713088 3059 raft_consensus.cc:3037] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:19:20.715622 3059 raft_consensus.cc:504] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.716312 3059 leader_election.cc:288] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [CANDIDATE]: Term 1 election: Requested vote from peers 6178831f5caf402fb386b5678013cbcc (127.15.164.194:38329), 9a56624fddf84bfd9b4a4954eae45ed7 (127.15.164.195:46045)
I20260812 11:19:20.716923 2744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007bccad5b1644a29dd41f621520cd79" candidate_uuid: "cd18698ff92e4d208f4a807f44e8f63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6178831f5caf402fb386b5678013cbcc"
I20260812 11:19:20.717023 2949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "007bccad5b1644a29dd41f621520cd79" candidate_uuid: "cd18698ff92e4d208f4a807f44e8f63f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a56624fddf84bfd9b4a4954eae45ed7"
I20260812 11:19:20.717159 2744 raft_consensus.cc:3037] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:19:20.717319 2949 raft_consensus.cc:3037] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:19:20.719754 2744 raft_consensus.cc:2454] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd18698ff92e4d208f4a807f44e8f63f in term 1.
I20260812 11:19:20.719913 2949 raft_consensus.cc:2454] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd18698ff92e4d208f4a807f44e8f63f in term 1.
I20260812 11:19:20.720309 2434 leader_election.cc:302] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6178831f5caf402fb386b5678013cbcc, cd18698ff92e4d208f4a807f44e8f63f; no voters:
I20260812 11:19:20.720805 3059 raft_consensus.cc:2781] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:19:20.721369 3059 raft_consensus.cc:686] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 1 LEADER]: Becoming Leader. State: Replica: cd18698ff92e4d208f4a807f44e8f63f, State: Running, Role: LEADER
I20260812 11:19:20.722025 3059 consensus_queue.cc:237] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } }
I20260812 11:19:20.727368 2274 catalog_manager.cc:5495] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f reported cstate change: term changed from 0 to 1, leader changed from <none> to cd18698ff92e4d208f4a807f44e8f63f (127.15.164.193). New cstate: current_term: 1 leader_uuid: "cd18698ff92e4d208f4a807f44e8f63f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd18698ff92e4d208f4a807f44e8f63f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 } health_report { overall_health: UNKNOWN } } }
W20260812 11:19:20.730719 3024 tablet.cc:2369] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:19:20.775925 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.768678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47256 (local address 127.15.164.193:35461)
0812 11:19:20.769005 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.769012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.769034 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:19:20.769148 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.769152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.769274 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.769424 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:19:20.769969 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.770842 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.772855 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.773303 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.773422 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.774221 (+ 799us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:19:20.774833 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:19:20.775090 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.775360 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.775453 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260812 11:19:20.786166 2949 raft_consensus.cc:1261] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 1 FOLLOWER]: Refusing update from remote peer cd18698ff92e4d208f4a807f44e8f63f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:19:20.786209 2744 raft_consensus.cc:1261] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 1 FOLLOWER]: Refusing update from remote peer cd18698ff92e4d208f4a807f44e8f63f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:19:20.787386 3069 consensus_queue.cc:1035] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a56624fddf84bfd9b4a4954eae45ed7" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 46045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:19:20.787834 3059 consensus_queue.cc:1035] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6178831f5caf402fb386b5678013cbcc" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:19:20.801265 3073 mvcc.cc:205] Tried to move back new op lower bound from 7317641464968069120 to 7317641464721215488. Current Snapshot: MvccSnapshot[applied={T|T < 7317641464968069120}]
I20260812 11:19:20.805279 3075 mvcc.cc:205] Tried to move back new op lower bound from 7317641464968069120 to 7317641464721215488. Current Snapshot: MvccSnapshot[applied={T|T < 7317641464968069120}]
I20260812 11:19:20.815449 2275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:19:20.815734 2275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:19:20.819629 2275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b83ecee07f44f46a3b89fae8df97423: Sending DeleteTablet for 3 replicas of tablet 007bccad5b1644a29dd41f621520cd79
I20260812 11:19:20.820981 2715 tablet_service.cc:1514] Processing DeleteTablet for tablet 007bccad5b1644a29dd41f621520cd79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:19:20 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58660
I20260812 11:19:20.821497 2498 tablet_service.cc:1514] Processing DeleteTablet for tablet 007bccad5b1644a29dd41f621520cd79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:19:20 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:47242
I20260812 11:19:20.822283 2912 tablet_service.cc:1514] Processing DeleteTablet for tablet 007bccad5b1644a29dd41f621520cd79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:19:20 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:46500
I20260812 11:19:20.823686 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 2402
I20260812 11:19:20.828791 3085 tablet_replica.cc:330] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: stopping tablet replica
I20260812 11:19:20.829563 3085 raft_consensus.cc:2229] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:19:20.836439 3086 tablet_replica.cc:330] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: stopping tablet replica
I20260812 11:19:20.837122 3086 raft_consensus.cc:2229] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:19:20.837764 3085 raft_consensus.cc:2258] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:19:20.837857 3086 raft_consensus.cc:2258] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:19:20.840951 3085 ts_tablet_manager.cc:1905] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:19:20.841291 3086 ts_tablet_manager.cc:1905] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:19:20.846834 3084 tablet_replica.cc:330] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: stopping tablet replica
I20260812 11:19:20.847519 3084 raft_consensus.cc:2229] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:19:20.848284 3084 raft_consensus.cc:2258] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:19:20.851198 3084 ts_tablet_manager.cc:1905] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 11:19:20 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:19:20.865746 3086 ts_tablet_manager.cc:1918] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:19:20.865989 3086 log.cc:1196] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/007bccad5b1644a29dd41f621520cd79
I20260812 11:19:20.866624 3086 ts_tablet_manager.cc:1939] T 007bccad5b1644a29dd41f621520cd79 P 9a56624fddf84bfd9b4a4954eae45ed7: Deleting consensus metadata
I20260812 11:19:20.866990 3085 ts_tablet_manager.cc:1918] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:19:20.867228 3085 log.cc:1196] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/007bccad5b1644a29dd41f621520cd79
I20260812 11:19:20.867256 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:20.826780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.15.164.193:35461)
0812 11:19:20.827049 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:20.827059 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:20.839059 (+ 12000us) server_negotiation.cc:407] Connection header received
0812 11:19:20.839435 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:20.839441 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:20.839540 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:20.839630 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:20.842178 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.843655 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.849009 (+ 5354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:20.849916 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:20.850060 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:20.856797 (+ 6737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:20.856816 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:20.856837 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:20.856892 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:20.861575 (+ 4683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.863432 (+ 1857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.863444 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.863448 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.863684 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:20.864220 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:20.864225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:20.864229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:20.864758 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:20.865299 (+ 541us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:20.866221 (+ 922us) server_negotiation.cc:299] Negotiation successful
0812 11:19:20.866556 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:19:20.867892 3085 ts_tablet_manager.cc:1939] T 007bccad5b1644a29dd41f621520cd79 P cd18698ff92e4d208f4a807f44e8f63f: Deleting consensus metadata
I20260812 11:19:20.869416 2596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:19:20.869695 3084 ts_tablet_manager.cc:1918] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:19:20.869899 3084 log.cc:1196] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/007bccad5b1644a29dd41f621520cd79
I20260812 11:19:20.870013 2254 catalog_manager.cc:4841] TS cd18698ff92e4d208f4a807f44e8f63f (127.15.164.193:35461): tablet 007bccad5b1644a29dd41f621520cd79 (table test-table [id=c2a96f38807d4343b9deb6235b041627]) successfully deleted
I20260812 11:19:20.870452 3084 ts_tablet_manager.cc:1939] T 007bccad5b1644a29dd41f621520cd79 P 6178831f5caf402fb386b5678013cbcc: Deleting consensus metadata
I20260812 11:19:20.872185 2252 catalog_manager.cc:4841] TS 6178831f5caf402fb386b5678013cbcc (127.15.164.194:38329): tablet 007bccad5b1644a29dd41f621520cd79 (table test-table [id=c2a96f38807d4343b9deb6235b041627]) successfully deleted
I20260812 11:19:20.872857 2254 catalog_manager.cc:4841] TS 9a56624fddf84bfd9b4a4954eae45ed7 (127.15.164.195:46045): tablet 007bccad5b1644a29dd41f621520cd79 (table test-table [id=c2a96f38807d4343b9deb6235b041627]) successfully deleted
I20260812 11:19:20.979745 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 2402
I20260812 11:19:21.011734 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 2615
Aug 12 11:19:21 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:19:21.030016 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:21.012697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.15.164.194:38329)
0812 11:19:21.012910 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:21.012917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:21.012940 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:19:21.013089 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:21.013096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:21.013170 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:21.013291 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:21.014697 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:21.015476 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:21.017043 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:21.017452 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:21.017593 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:21.022670 (+ 5077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:21.022689 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:21.022709 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:21.022766 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:21.026672 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:21.027635 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:21.027645 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:21.027648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:21.027813 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:21.028246 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:21.028251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:21.028265 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:21.028713 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:21.029044 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:21.029397 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 11:19:21.029639 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:19:21.031044 2802 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:19:21.123966 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 2615
I20260812 11:19:21.150874 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 2822
Aug 12 11:19:21 dist-test-slave-7kzw krb5kdc[1532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:19:21.168689 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:19:21.151734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.15.164.195:46045)
0812 11:19:21.151955 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 11:19:21.151960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:19:21.152090 (+ 130us) server_negotiation.cc:407] Connection header received
0812 11:19:21.152242 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:19:21.152247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:19:21.152341 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:19:21.152452 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:19:21.154042 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:21.154971 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:21.156461 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:19:21.156871 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:19:21.156981 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:19:21.162020 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:19:21.162038 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:19:21.162057 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:19:21.162098 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:19:21.165314 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:21.166276 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:21.166285 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:21.166287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:21.166438 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:19:21.166993 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:19:21.166997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:19:21.167000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:19:21.167443 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:19:21.167696 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 11:19:21.168084 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 11:19:21.168320 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 11:19:21.169541 3010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:19:21.260951 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 2822
I20260812 11:19:21.288074 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 2230
I20260812 11:19:21.289458 2321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:19:21.406764 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 2230
I20260812 11:19:21.447125 16019 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:19:21.793371 16019 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:19:21.793795 16019 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:19:22.139927 16019 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:19:22.140 UTC [1583] LOG: received smart shutdown request
2026-08-12 11:19:22.145 UTC [1583] LOG: background worker "logical replication launcher" (PID 1598) exited with exit code 1
2026-08-12 11:19:22.145 UTC [1590] LOG: shutting down
2026-08-12 11:19:22.338 UTC [1583] LOG: database system is shut down
2026-08-12T11:19:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53980 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:19:22 dist-test-slave-7kzw krb5kdc[3104](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:19:22 dist-test-slave-7kzw krb5kdc[3104](info): set up 2 sockets
Aug 12 11:19:22 dist-test-slave-7kzw krb5kdc[3104](info): commencing operation
krb5kdc: starting...
W20260812 11:19:23.851500 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.010s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:19:24 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:19:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:19:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangeradmin_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangeradmin_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangerlookup_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangerlookup_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
I20260812 11:19:24.250653 16019 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskghXBKM/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/postgres -l logfile start
2026-08-12 11:19:26.955 UTC [3155] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:19:26.955 UTC [3155] LOG: listening on IPv4 address "127.15.164.212", port 53151
2026-08-12 11:19:26.959 UTC [3155] LOG: listening on Unix socket "/tmp/.s.PGSQL.53151"
2026-08-12 11:19:26.983 UTC [3160] LOG: database system was shut down at 2026-08-12 11:19:25 UTC
2026-08-12 11:19:26.988 UTC [3155] LOG: database system is ready to accept connections
I20260812 11:19:28.261355 16019 mini_postgres.cc:96] Postgres bound to 53151
2026-08-12 11:19:28.284 UTC [3168] FATAL: database "slave" does not exist
127.15.164.212:53151 - accepting connections
I20260812 11:19:28.285300 16019 mini_ranger.cc:161] Starting Ranger...
I20260812 11:19:28.316246 16019 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:19:28.850353 16019 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:19:28.850502 16019 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin
2026-08-12 11:19:29,132 [I] DB FLAVOR :POSTGRES
2026-08-12 11:19:29,133 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:19:29,133 [I] Checking connection..
2026-08-12 11:19:29,133 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:19:29,409 [I] Checking connection passed.
2026-08-12 11:19:29,409 [I] --------- Verifying version history table ---------
2026-08-12 11:19:29,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:19:29,669 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:19:29,669 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:19:29,923 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:19:29,923 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:19:29,923 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:19:30.183 UTC [3283] WARNING: there is no transaction in progress
2026-08-12 11:19:30,193 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:19:30,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:19:30,452 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:19:30,452 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:19:30,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:19:30,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:19:30,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7kzw.c.gcp-upstream.internal','N') ;"
2026-08-12 11:19:31,234 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:19:31,481 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:19:31,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:19:31,759 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:19:31,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:19:32,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:19:32,290 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:19:32,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:19:33.355 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.373 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.391 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.409 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.429 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.451 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.521 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.528 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.544 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.555 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.566 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.582 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.593 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.600 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.608 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:33.616 UTC [3462] WARNING: there is no transaction in progress
2026-08-12 11:19:34,360 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:19:34,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:19:34,644 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:19:34,645 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:19:34,906 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:19:34,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:19:35,164 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:19:35,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:19:35,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:19:35,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7kzw.c.gcp-upstream.internal';"
2026-08-12 11:19:35,934 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:19:35,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:19:36,207 [I] DB_PATCHES have already been applied
I20260812 11:19:36.213336 16019 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskghXBKM/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:19:36.213425 16019 mini_ranger.cc:193] Using host: 127.15.164.212
I20260812 11:19:36.232731 16019 mini_ranger.cc:227] Ranger admin URL: http://127.15.164.212:46443
Aug 12, 2026 11:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:19:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:19:37 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:19:37.656271 16019 mini_ranger.cc:160] Time spent starting Ranger: real 9.371s user 0.003s sys 0.052s
Aug 12, 2026 11:19:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:19:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 11:19:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:19:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:19:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:19:59.516000 16019 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangerkms_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/rangerkms_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.164.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.164.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.164.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/HTTP_127.15.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:19:59 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533599, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:19:59.727312 16019 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:19:59.756139 16019 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:20:00.696010 16019 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:20:00.696153 16019 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms
I20260812 11:20:00.696198 16019 mini_ranger_kms.cc:227] Using postgres at 127.15.164.212:53151
2026-08-12 11:20:01,072 [I] DB FLAVOR :POSTGRES
2026-08-12 11:20:01,072 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:20:01,072 [I] Checking connection
2026-08-12 11:20:01,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:20:01,314 [I] connection success
2026-08-12 11:20:01,314 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:20:01,314 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:20:01,315 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:20:01,558 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:20:01,559 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:20:01,559 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:20:01,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.164.212:53151/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:20:01,834 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:20:02.329725 16019 mini_ranger_kms.cc:310] Created kms service
I20260812 11:20:02.493126 16019 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:20:02.538133 16019 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:20:02 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533599, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:02.918332 16019 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:20:02.918932 16019 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms:/tmp/dist-test-taskghXBKM/build/asan/bin/postgresql.jar:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskghXBKM/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:20:02.919020 16019 mini_ranger_kms.cc:240] Using host: 127.15.164.212
I20260812 11:20:02.938856 16019 mini_ranger_kms.cc:276] Ranger KMS PID: 3746
I20260812 11:20:02.938992 16019 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.164.212:34593
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:20:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:20:05 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533605, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:05.776348 16019 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.049s user 0.072s sys 0.332s
I20260812 11:20:05.776647 16019 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:20:05.776849 16019 mini_ranger_kms.cc:401] 127.15.164.212:34593/kms/v1/keys
Aug 12 11:20:05 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533605, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
Aug 12 11:20:06 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533605, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.164.212@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
Aug 12 11:20:08 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:20:08.682555 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33789
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:33789
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:09.054602 3826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:09.055024 3826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:09.055191 3826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:09.062951 3826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:09.063112 3826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:09.063217 3826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:09.063313 3826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:09.063401 3826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:09.074087 3826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.164.212:34593/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:33789
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:09.075495 3826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:09.076885 3826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:09.089848 3834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:09.089941 3835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:09.089905 3840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:09.090543 3826 server_base.cc:1034] running on GCE node
I20260812 11:20:09.091360 3826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:09.092775 3826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:09.094020 3826 hybrid_clock.cc:648] HybridClock initialized: now 1786533609093981 us; error 32 us; skew 500 ppm
I20260812 11:20:09.094398 3826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:09 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533609, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:09.097734 3826 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:09.099431 3826 webserver.cc:460] Webserver started at http://127.15.164.254:45993/ using document root <none> and password file <none>
I20260812 11:20:09.100117 3826 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:09.100273 3826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:09.100613 3826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:20:09 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533609, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:09.164826 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "b19ec66755124df9bff84a0a32f0f881"
format_stamp: "Formatted at 2026-08-12 11:20:09 on dist-test-slave-7kzw"
server_key: "33d848c01995713381472b146b270e9f"
server_key_iv: "61585fa606678e54f8a8b01c1f8b5db6"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:09.166412 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "b19ec66755124df9bff84a0a32f0f881"
format_stamp: "Formatted at 2026-08-12 11:20:09 on dist-test-slave-7kzw"
server_key: "33d848c01995713381472b146b270e9f"
server_key_iv: "61585fa606678e54f8a8b01c1f8b5db6"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:09.174867 3826 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260812 11:20:09.198241 3849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:09.200285 3826 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:20:09.200557 3826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "b19ec66755124df9bff84a0a32f0f881"
format_stamp: "Formatted at 2026-08-12 11:20:09 on dist-test-slave-7kzw"
server_key: "33d848c01995713381472b146b270e9f"
server_key_iv: "61585fa606678e54f8a8b01c1f8b5db6"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:09.200850 3826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:09.228822 3826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:09.233790 3826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:09.234153 3826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:09.256011 3826 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:33789
I20260812 11:20:09.256088 3919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:33789 every 8 connection(s)
I20260812 11:20:09.257620 3826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:09.262979 3921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:09.266801 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 3826
I20260812 11:20:09.267057 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:20:09.267758 16019 external_mini_cluster.cc:1428] Setting key 19f262ea33bf5b19ab6d013e410d24b5
I20260812 11:20:09.279240 3921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Bootstrap starting.
I20260812 11:20:09.284947 3921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:09.286715 3921 log.cc:824] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:09.290280 3921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: No bootstrap required, opened a new log
Aug 12 11:20:09 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:09.300019 3921 raft_consensus.cc:348] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:09.300516 3921 raft_consensus.cc:374] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:09.300683 3921 raft_consensus.cc:729] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19ec66755124df9bff84a0a32f0f881, State: Initialized, Role: FOLLOWER
I20260812 11:20:09.301489 3921 consensus_queue.cc:260] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:09.301821 3921 raft_consensus.cc:388] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:09.302058 3921 raft_consensus.cc:482] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:09.302289 3921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:09.303531 3925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:09.270595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49420 (local address 127.15.164.254:33789)
0812 11:20:09.279615 (+ 9020us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:09.279628 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:09.279674 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:20:09.281468 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:09.281493 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:09.281901 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:09.282354 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:09.283932 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:09.285442 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:09.286907 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:09.287754 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:09.287971 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:09.293360 (+ 5389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:09.293374 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:09.293397 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:09.293452 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:09.297931 (+ 4479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:09.298960 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:09.298970 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:09.298980 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:09.299180 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:09.299678 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:09.299683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:09.299686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:09.300506 (+ 820us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:09.300865 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:09.301493 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 11:20:09.301957 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8755,"thread_start_us":8379,"threads_started":1}
I20260812 11:20:09.305908 3921 raft_consensus.cc:504] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:09.306579 3921 leader_election.cc:302] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b19ec66755124df9bff84a0a32f0f881; no voters:
I20260812 11:20:09.307475 3921 leader_election.cc:288] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:09.307686 3929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:09.310555 3921 sys_catalog.cc:564] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:09.315117 3929 raft_consensus.cc:686] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 LEADER]: Becoming Leader. State: Replica: b19ec66755124df9bff84a0a32f0f881, State: Running, Role: LEADER
I20260812 11:20:09.315946 3929 consensus_queue.cc:237] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:09.320180 3931 sys_catalog.cc:455] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b19ec66755124df9bff84a0a32f0f881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } } }
I20260812 11:20:09.320674 3931 sys_catalog.cc:458] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:09.321285 3932 sys_catalog.cc:455] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b19ec66755124df9bff84a0a32f0f881. Latest consensus state: current_term: 1 leader_uuid: "b19ec66755124df9bff84a0a32f0f881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } } }
I20260812 11:20:09.321635 3932 sys_catalog.cc:458] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:09.333424 3942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:09.333725 3921 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:20:09.350525 3942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:09.377367 3942 catalog_manager.cc:1347] Generated new cluster ID: 6452fc7ddcc041dfa6e987b067cafd40
I20260812 11:20:09.377503 3942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:09.425997 3942 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:09.428273 3942 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:09.445467 3942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Generated new TSK 0
I20260812 11:20:09.446759 3942 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:20:10.246634 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:20:10 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:20:10.744704 3988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:10.745085 3988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:10.745263 3988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:10.752900 3988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:10.753065 3988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:10.753242 3988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:10.767198 3988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:10.768862 3988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:10.770895 3988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:10.802812 4009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:10.806234 4008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:10.807142 4011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:10.809595 3988 server_base.cc:1034] running on GCE node
I20260812 11:20:10.810637 3988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:10.812191 3988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:10.813526 3988 hybrid_clock.cc:648] HybridClock initialized: now 1786533610813459 us; error 51 us; skew 500 ppm
I20260812 11:20:10.813988 3988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:10 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:10.818771 3988 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:10.831090 3988 webserver.cc:460] Webserver started at http://127.15.164.193:34459/ using document root <none> and password file <none>
I20260812 11:20:10.832257 3988 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:10.832430 3988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:10.832851 3988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:20:10 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:10.860227 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "3c55c7b6df6841c98e1c35e58857bc57"
format_stamp: "Formatted at 2026-08-12 11:20:10 on dist-test-slave-7kzw"
server_key: "c82c4a29a4e848911d22ae1628227b28"
server_key_iv: "d36399de2ee167949bb7f5cac1f0a78f"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:10.861529 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "3c55c7b6df6841c98e1c35e58857bc57"
format_stamp: "Formatted at 2026-08-12 11:20:10 on dist-test-slave-7kzw"
server_key: "c82c4a29a4e848911d22ae1628227b28"
server_key_iv: "d36399de2ee167949bb7f5cac1f0a78f"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:10.884958 3988 fs_manager.cc:691] Time spent creating directory manager: real 0.023s user 0.010s sys 0.011s
I20260812 11:20:10.919576 4022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:10.922210 3988 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.010s sys 0.004s
I20260812 11:20:10.923290 3988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "3c55c7b6df6841c98e1c35e58857bc57"
format_stamp: "Formatted at 2026-08-12 11:20:10 on dist-test-slave-7kzw"
server_key: "c82c4a29a4e848911d22ae1628227b28"
server_key_iv: "d36399de2ee167949bb7f5cac1f0a78f"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:10.923676 3988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 11:20:10 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:11.009828 3988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:11.016788 3988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:11.017328 3988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:11.019085 3988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:11.021890 3988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:11.022010 3988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:11.022219 3988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:11.022367 3988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:20:11 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:11.593536 4191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:35581 every 8 connection(s)
I20260812 11:20:11.593971 3988 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:35581
I20260812 11:20:11.595898 3988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:11.599232 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 3988
I20260812 11:20:11.599498 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:20:11.600469 16019 external_mini_cluster.cc:1428] Setting key e20660038ec262bb3708843c02085102
Aug 12 11:20:11 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:11.655422 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:11.603402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:46069 (local address 127.15.164.254:33789)
0812 11:20:11.623927 (+ 20525us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:11.623935 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:11.623963 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:20:11.624039 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:11.624046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:11.624140 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:11.624283 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:11.627178 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:11.628635 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:11.631486 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:11.632203 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:11.632366 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:11.645346 (+ 12980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:11.645356 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:11.645361 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:11.645410 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:11.649611 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:11.650853 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:11.650860 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:11.650865 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:11.651061 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:11.651707 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:11.651714 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:11.651718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:11.652162 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:11.652325 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:11.654692 (+ 2367us) server_negotiation.cc:299] Negotiation successful
0812 11:20:11.654975 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20306,"thread_start_us":23529,"threads_started":1}
I20260812 11:20:11.671919 4195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:11.604187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.193:46069)
0812 11:20:11.618658 (+ 14471us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:11.618729 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:11.621243 (+ 2514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:11.624831 (+ 3588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:11.624846 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:11.625632 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:11.626692 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:11.626727 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:11.628924 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:11.628930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:11.631248 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:11.631281 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:11.639799 (+ 8518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:11.639810 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:11.640239 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:11.641487 (+ 1248us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:11.641531 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:11.644945 (+ 3414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:11.649844 (+ 4899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:11.649856 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:11.649878 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:11.650643 (+ 765us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:11.651236 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:11.651242 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:11.651246 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:11.651544 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:11.652414 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:11.652423 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:11.652951 (+ 528us) client_negotiation.cc:769] Sending connection context
0812 11:20:11.653289 (+ 338us) client_negotiation.cc:240] Negotiation successful
0812 11:20:11.653903 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14066,"thread_start_us":17431,"threads_started":1}
I20260812 11:20:11.679411 4192 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:11.679822 4192 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:11.680796 4192 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:11.683883 3875 ts_manager.cc:194] Registered new tserver with Master: 3c55c7b6df6841c98e1c35e58857bc57 (127.15.164.193:35581)
I20260812 11:20:11.686090 3875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:46069
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
W20260812 11:20:11.743818 16019 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.164.194: real 0.140s user 0.000s sys 0.025s
I20260812 11:20:11.744999 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:12.122233 4200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:12.122661 4200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:12.122830 4200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:12.131091 4200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:12.131248 4200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:12.131448 4200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:12.141700 4200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:12.143162 4200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:12.144698 4200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:12.158537 4215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:12.158615 4217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:12.158630 4214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:12.159261 4200 server_base.cc:1034] running on GCE node
I20260812 11:20:12.159915 4200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:12.160929 4200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:12.162173 4200 hybrid_clock.cc:648] HybridClock initialized: now 1786533612162092 us; error 71 us; skew 500 ppm
I20260812 11:20:12.162585 4200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:12.166978 4200 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:12.168561 4200 webserver.cc:460] Webserver started at http://127.15.164.194:39299/ using document root <none> and password file <none>
I20260812 11:20:12.169276 4200 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:12.169394 4200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:12.169687 4200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:12.187652 4200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "03c17cebf511455aa2219dbfce26f86d"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "e4e714741846568b5d93dd6dd76c1a20"
server_key_iv: "692f2118b00cd4282588bbaeb653cb96"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.188958 4200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "03c17cebf511455aa2219dbfce26f86d"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "e4e714741846568b5d93dd6dd76c1a20"
server_key_iv: "692f2118b00cd4282588bbaeb653cb96"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.197435 4200 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260812 11:20:12.215449 4229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.217341 4200 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:20:12.217557 4200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "03c17cebf511455aa2219dbfce26f86d"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "e4e714741846568b5d93dd6dd76c1a20"
server_key_iv: "692f2118b00cd4282588bbaeb653cb96"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.217859 4200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:12.269037 4200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:12.273897 4200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:12.274241 4200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:12.275364 4200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:12.276923 4200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:12.277012 4200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.277119 4200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:12.277170 4200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.315330 4200 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:43845
I20260812 11:20:12.315380 4407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:43845 every 8 connection(s)
I20260812 11:20:12.316797 4200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:12.319913 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 4200
I20260812 11:20:12.320138 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:20:12.320885 16019 external_mini_cluster.cc:1428] Setting key cecd3e5e326c7ca177b9f747fd46300a
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:12.343083 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:12.319816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:52421 (local address 127.15.164.254:33789)
0812 11:20:12.326569 (+ 6753us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:12.326580 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:12.326597 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:20:12.326654 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:12.326657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:12.326717 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:12.326805 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:12.329007 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.329798 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.331763 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.332189 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.332336 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:12.336503 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:12.336508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:12.336512 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:12.336551 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:12.339363 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.340381 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.340386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.340388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.340520 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.341113 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.341116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.341118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.341410 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:12.341524 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:12.342621 (+ 1097us) server_negotiation.cc:299] Negotiation successful
0812 11:20:12.342812 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6568,"thread_start_us":6438,"threads_started":1}
I20260812 11:20:12.344676 4416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:12.320350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.194:52421)
0812 11:20:12.322319 (+ 1969us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:12.322402 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:12.325676 (+ 3274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:12.327133 (+ 1457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:12.327148 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:12.327842 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:12.328769 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:12.328801 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.330089 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.330093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:12.331558 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:12.331598 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.332436 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.332445 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:12.332708 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:12.333468 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:12.333493 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:12.336237 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:12.339524 (+ 3287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:12.339537 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:12.339559 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:12.340243 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:12.340646 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:12.340654 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:12.340661 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:12.340989 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:12.341554 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:12.341566 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:12.342093 (+ 527us) client_negotiation.cc:769] Sending connection context
0812 11:20:12.342426 (+ 333us) client_negotiation.cc:240] Negotiation successful
0812 11:20:12.343068 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1603,"thread_start_us":1365,"threads_started":1}
I20260812 11:20:12.346496 4409 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:12.346881 4409 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:12.347803 4409 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:12.349552 3875 ts_manager.cc:194] Registered new tserver with Master: 03c17cebf511455aa2219dbfce26f86d (127.15.164.194:43845)
I20260812 11:20:12.350841 3875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:52421
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:20:12.386111 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:12.690301 4192 heartbeater.cc:503] Master 127.15.164.254:33789 was elected leader, sending a full tablet report...
W20260812 11:20:12.733057 4421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:12.733346 4421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:12.733441 4421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:12.740692 4421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:12.740804 4421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:12.740916 4421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:12.750797 4421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:12.752094 4421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:12.753412 4421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:12.767256 4434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:12.767287 4432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:12.767295 4430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:12.768028 4421 server_base.cc:1034] running on GCE node
I20260812 11:20:12.768719 4421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:12.769709 4421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:12.770962 4421 hybrid_clock.cc:648] HybridClock initialized: now 1786533612770907 us; error 32 us; skew 500 ppm
I20260812 11:20:12.771356 4421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:12.774760 4421 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:12.776310 4421 webserver.cc:460] Webserver started at http://127.15.164.195:38579/ using document root <none> and password file <none>
I20260812 11:20:12.777048 4421 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:12.777204 4421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:12.777593 4421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:12.794960 4421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "f031b64bd8584cf4b7f78e4b9af35d29"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "15d77e8a49600d213c7d4880871023e1"
server_key_iv: "9cbf11f6936d33616d414e04790525c9"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.796118 4421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "f031b64bd8584cf4b7f78e4b9af35d29"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "15d77e8a49600d213c7d4880871023e1"
server_key_iv: "9cbf11f6936d33616d414e04790525c9"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.802416 4421 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:20:12.820058 4445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.821580 4421 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:20:12.821787 4421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "f031b64bd8584cf4b7f78e4b9af35d29"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "15d77e8a49600d213c7d4880871023e1"
server_key_iv: "9cbf11f6936d33616d414e04790525c9"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:12.822037 4421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:12.840447 4421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:12.844661 4421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:12.844992 4421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:12.846174 4421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:12.847682 4421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:12.847762 4421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.847903 4421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:12.847957 4421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:12.883260 4421 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:41513
I20260812 11:20:12.883307 4617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:41513 every 8 connection(s)
I20260812 11:20:12.884626 4421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:12.893061 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 4421
I20260812 11:20:12.893291 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:20:12.893937 16019 external_mini_cluster.cc:1428] Setting key 3ffd54a0634a270b165762aaad3a09cb
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533612, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:12.904814 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:12.887340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:45863 (local address 127.15.164.254:33789)
0812 11:20:12.887933 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:12.887938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:12.888637 (+ 699us) server_negotiation.cc:407] Connection header received
0812 11:20:12.890497 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:12.890505 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:12.890604 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:12.890732 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:12.892200 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.893014 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.895160 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.895710 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.895812 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:12.899461 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:12.899466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:12.899470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:12.899503 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:12.902004 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.902774 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.902778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.902781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.902909 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.903333 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.903336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.903338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.903610 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:12.903728 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:12.904387 (+ 659us) server_negotiation.cc:299] Negotiation successful
0812 11:20:12.904561 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":302,"threads_started":1}
I20260812 11:20:12.905825 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:12.887773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.195:45863)
0812 11:20:12.888469 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:12.888508 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:12.890186 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:12.890989 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:12.890997 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:12.891426 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:12.892011 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:12.892029 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.893223 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.893231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:12.894983 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:12.895025 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.895949 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.895964 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:12.896182 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:12.896929 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:12.896960 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:12.899253 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:12.902136 (+ 2883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:12.902144 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:12.902157 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:12.902661 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:12.903011 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:12.903014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:12.903017 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:12.903228 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:12.903743 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:12.903749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:12.904048 (+ 299us) client_negotiation.cc:769] Sending connection context
0812 11:20:12.904276 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 11:20:12.904650 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":291,"threads_started":1}
I20260812 11:20:12.907454 4619 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:12.907816 4619 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:12.908619 4619 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:12.910213 3875 ts_manager.cc:194] Registered new tserver with Master: f031b64bd8584cf4b7f78e4b9af35d29 (127.15.164.195:41513)
I20260812 11:20:12.911170 3875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:45863
I20260812 11:20:12.922238 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:12.924147 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 3988
Aug 12 11:20:12 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:20:12.942009 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:12.925163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.15.164.193:35581)
0812 11:20:12.925871 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:12.925880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:12.925911 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:20:12.925990 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:12.926001 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:12.926250 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:12.926450 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:12.928145 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.929173 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.930809 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:12.931476 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:12.931625 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:12.935916 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:12.935928 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:12.935944 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:12.935985 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:12.938953 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.939691 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.939698 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.939701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.939851 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:12.940251 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:12.940255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:12.940259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:12.940619 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:12.940992 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:12.941357 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 11:20:12.941649 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":323,"threads_started":1}
I20260812 11:20:12.943449 4183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:13.027704 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 3988
I20260812 11:20:13.057556 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 4200
Aug 12 11:20:13 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:20:13.079743 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:13.062944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54592 (local address 127.15.164.194:43845)
0812 11:20:13.063596 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:13.063604 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:13.063663 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:20:13.063758 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:13.063768 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:13.063993 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:13.064133 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:13.065452 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:13.066692 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:13.068175 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:13.068800 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:13.068947 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:13.073892 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:13.073904 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:13.073919 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:13.073960 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:13.076981 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:13.077682 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:13.077689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:13.077691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:13.077828 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:13.078155 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:13.078158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:13.078160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:13.078564 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:13.078802 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:13.079108 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 11:20:13.079331 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":373,"threads_started":1}
I20260812 11:20:13.081202 4403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:13.166204 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 4200
I20260812 11:20:13.193087 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 4421
Aug 12 11:20:13 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:20:13.211894 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:13.194199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51052 (local address 127.15.164.195:41513)
0812 11:20:13.194926 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:13.194934 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:13.194967 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:20:13.195031 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:13.195038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:13.195290 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:13.195423 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:13.196858 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:13.197920 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:13.199455 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:13.200012 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:13.200113 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:13.205284 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:13.205297 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:13.205314 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:13.205355 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:13.208775 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:13.209518 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:13.209527 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:13.209530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:13.209795 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:13.210164 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:13.210167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:13.210170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:13.210711 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:13.211061 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:13.211208 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 11:20:13.211432 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":398,"threads_started":1}
I20260812 11:20:13.213305 4610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:13.297284 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 4421
I20260812 11:20:13.322738 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 3826
I20260812 11:20:13.324147 3914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:13.434564 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 3826
I20260812 11:20:13.470000 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33789
--webserver_interface=127.15.164.254
--webserver_port=45993
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:33789
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:13.828613 4634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:13.828943 4634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:13.829037 4634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:13.836090 4634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:13.836196 4634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:13.836243 4634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:13.836301 4634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:13.836349 4634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:13.846243 4634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:33789
--ranger_config_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=45993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:13.847728 4634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:13.849030 4634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:13.861282 4642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:13.861327 4645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:13.861352 4650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:13.862620 4634 server_base.cc:1034] running on GCE node
I20260812 11:20:13.863488 4634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:13.864995 4634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:13.866227 4634 hybrid_clock.cc:648] HybridClock initialized: now 1786533613866194 us; error 64 us; skew 500 ppm
I20260812 11:20:13.866653 4634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:13 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533613, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:13.869889 4634 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:13.871415 4634 webserver.cc:460] Webserver started at http://127.15.164.254:45993/ using document root <none> and password file <none>
I20260812 11:20:13.872076 4634 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:13.872225 4634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:20:13 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533613, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:13.928563 4634 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:20:13.932446 4661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:13.934158 4634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:20:13.934368 4634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "b19ec66755124df9bff84a0a32f0f881"
format_stamp: "Formatted at 2026-08-12 11:20:09 on dist-test-slave-7kzw"
server_key: "33d848c01995713381472b146b270e9f"
server_key_iv: "61585fa606678e54f8a8b01c1f8b5db6"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:13.935745 4634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:13.956539 4634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:13.960722 4634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:13.961007 4634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:13.983194 4634 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:33789
I20260812 11:20:13.983242 4746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:33789 every 8 connection(s)
I20260812 11:20:13.984896 4634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:13.988799 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 4634
I20260812 11:20:13.989828 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:35581
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:33789
--webserver_port=34459
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:13.992375 4748 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:20:13.995741 4748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Bootstrap starting.
I20260812 11:20:14.015556 4748 log.cc:824] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:14.024787 4748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:20:14.025358 4748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Bootstrap complete.
I20260812 11:20:14.034963 4748 raft_consensus.cc:348] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:14.035881 4748 raft_consensus.cc:729] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19ec66755124df9bff84a0a32f0f881, State: Initialized, Role: FOLLOWER
I20260812 11:20:14.036507 4748 consensus_queue.cc:260] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:14.036769 4748 raft_consensus.cc:388] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:14.036903 4748 raft_consensus.cc:482] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:14.037098 4748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:20:14.041712 4748 raft_consensus.cc:504] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:14.042294 4748 leader_election.cc:302] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b19ec66755124df9bff84a0a32f0f881; no voters:
I20260812 11:20:14.043017 4748 leader_election.cc:288] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:20:14.043181 4753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:20:14.044322 4753 raft_consensus.cc:686] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [term 2 LEADER]: Becoming Leader. State: Replica: b19ec66755124df9bff84a0a32f0f881, State: Running, Role: LEADER
I20260812 11:20:14.045007 4753 consensus_queue.cc:237] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } }
I20260812 11:20:14.045419 4748 sys_catalog.cc:564] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:14.048303 4755 sys_catalog.cc:455] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b19ec66755124df9bff84a0a32f0f881. Latest consensus state: current_term: 2 leader_uuid: "b19ec66755124df9bff84a0a32f0f881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } } }
I20260812 11:20:14.048775 4755 sys_catalog.cc:458] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:14.049472 4754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b19ec66755124df9bff84a0a32f0f881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b19ec66755124df9bff84a0a32f0f881" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33789 } } }
I20260812 11:20:14.049832 4754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:14.058517 4761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:14.064757 4761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:14.066311 4761 catalog_manager.cc:1259] Loaded cluster ID: 6452fc7ddcc041dfa6e987b067cafd40
I20260812 11:20:14.066493 4761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:14.070627 4761 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:14.072245 4761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Loaded TSK: 0
I20260812 11:20:14.074007 4761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:20:14.084587 4748 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260812 11:20:14.468575 4751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:14.469080 4751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:14.469282 4751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:14.478565 4751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:14.478719 4751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:14.478914 4751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:14.492411 4751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:35581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=34459
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:14.494390 4751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:14.496273 4751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:14.543387 4795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:14.545287 4794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:14.551563 4798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:14.552960 4751 server_base.cc:1034] running on GCE node
I20260812 11:20:14.553707 4751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:14.555099 4751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:14.556413 4751 hybrid_clock.cc:648] HybridClock initialized: now 1786533614556338 us; error 58 us; skew 500 ppm
I20260812 11:20:14.557286 4751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:14 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533614, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:14.562605 4751 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:14.580443 4751 webserver.cc:460] Webserver started at http://127.15.164.193:34459/ using document root <none> and password file <none>
I20260812 11:20:14.581334 4751 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:14.581527 4751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:20:14 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533614, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:14.626592 4751 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.010s sys 0.004s
I20260812 11:20:14.630978 4810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:14.632973 4751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:20:14.633258 4751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "3c55c7b6df6841c98e1c35e58857bc57"
format_stamp: "Formatted at 2026-08-12 11:20:10 on dist-test-slave-7kzw"
server_key: "c82c4a29a4e848911d22ae1628227b28"
server_key_iv: "d36399de2ee167949bb7f5cac1f0a78f"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:14.634835 4751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:14.669081 4751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:14.674734 4751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:14.675034 4751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:14.676304 4751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:14.678239 4751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:14.678356 4751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:14.678488 4751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:14.678570 4751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 11:20:14.742964 4751 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:35581
I20260812 11:20:14.743000 5008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:35581 every 8 connection(s)
I20260812 11:20:14.744750 4751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:14.746716 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 4751
I20260812 11:20:14.747752 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:43845
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:33789
--webserver_port=39299
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:20:14 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533614, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:14.808681 5015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:14.748929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.193:50307)
0812 11:20:14.775660 (+ 26731us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:14.775763 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:14.781930 (+ 6167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:14.784850 (+ 2920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:14.784866 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:14.785714 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:14.787178 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:14.787213 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:14.789862 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:14.789870 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:14.791983 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:14.792018 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:14.793729 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:14.793739 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:14.794029 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:14.794945 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:14.794981 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:14.798009 (+ 3028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:14.802959 (+ 4950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:14.802969 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:14.802986 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:14.803664 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:14.804285 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:14.804291 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:14.804295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:14.804597 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:14.805717 (+ 1120us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:14.805726 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:14.806291 (+ 565us) client_negotiation.cc:769] Sending connection context
0812 11:20:14.806647 (+ 356us) client_negotiation.cc:240] Negotiation successful
0812 11:20:14.807253 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26192,"thread_start_us":27726,"threads_started":1}
I20260812 11:20:14.811581 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:14.750320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:50307 (local address 127.15.164.254:33789)
0812 11:20:14.780365 (+ 30045us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:14.780393 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:14.780471 (+ 78us) server_negotiation.cc:407] Connection header received
0812 11:20:14.783545 (+ 3074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:14.783566 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:14.784119 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:14.784574 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:14.787495 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:14.789582 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:14.792216 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:14.793431 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:14.793651 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:14.798360 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:14.798371 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:14.798393 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:14.798450 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:14.802756 (+ 4306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:14.803879 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:14.803888 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:14.803898 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:14.804122 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:14.804774 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:14.804779 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:14.804782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:14.805504 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:14.809459 (+ 3955us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:14.809785 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:20:14.810241 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29636,"thread_start_us":30054,"threads_started":1}
I20260812 11:20:14.815286 5010 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:14.815653 5010 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:14.816718 5010 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
W20260812 11:20:14.820604 5010 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:33789 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:20:14.820902 5010 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:14.821276 5010 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:14.822758 5010 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:14.823105 5010 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
W20260812 11:20:14.824440 5010 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:20:15.193050 5017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:15.193396 5017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:15.193579 5017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:15.202284 5017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:15.202451 5017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:15.202667 5017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:15.213356 5017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=39299
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:15.214872 5017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:15.216325 5017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:15.234938 5037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:15.238389 5038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:15.239449 5040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:15.239531 5017 server_base.cc:1034] running on GCE node
I20260812 11:20:15.240547 5017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:15.241709 5017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:15.242928 5017 hybrid_clock.cc:648] HybridClock initialized: now 1786533615242876 us; error 46 us; skew 500 ppm
I20260812 11:20:15.243299 5017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:15 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:15.247026 5017 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:15.248955 5017 webserver.cc:460] Webserver started at http://127.15.164.194:39299/ using document root <none> and password file <none>
I20260812 11:20:15.249972 5017 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:15.250185 5017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:20:15 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:15.275265 5017 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:20:15.295176 5053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:15.297266 5017 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.005s sys 0.015s
I20260812 11:20:15.297547 5017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "03c17cebf511455aa2219dbfce26f86d"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "e4e714741846568b5d93dd6dd76c1a20"
server_key_iv: "692f2118b00cd4282588bbaeb653cb96"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:15.299142 5017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:15.320065 5017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:15.325623 5017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:15.326014 5017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:15.331274 5017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:15.333122 5017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:15.333261 5017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:15.333381 5017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:15.333460 5017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:15.386961 5017 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:43845
I20260812 11:20:15.387029 5238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:43845 every 8 connection(s)
I20260812 11:20:15.389227 5017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:15.399590 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 5017
I20260812 11:20:15.400521 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.164.212:34593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:41513
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:33789
--webserver_port=38579
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:46007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:20:15 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 11:20:15 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:15.421978 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:15.395747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:42867 (local address 127.15.164.254:33789)
0812 11:20:15.396289 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:15.396296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:15.397378 (+ 1082us) server_negotiation.cc:407] Connection header received
0812 11:20:15.400417 (+ 3039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:15.400425 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:15.400536 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:15.400633 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:15.403155 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:15.404457 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:15.407333 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:15.408160 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:15.408290 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:15.413431 (+ 5141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:15.413438 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:15.413445 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:15.413492 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:15.417456 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:15.418631 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:15.418638 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:15.418643 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:15.418836 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:15.419471 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:15.419477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:15.419483 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:15.419926 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:15.420090 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:15.421229 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0812 11:20:15.421509 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":281,"threads_started":1}
I20260812 11:20:15.424980 5243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:15.396227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.194:42867)
0812 11:20:15.397179 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:15.397245 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:15.400041 (+ 2796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:15.401260 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:15.401273 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:15.401928 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:15.402905 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:15.402937 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:15.404726 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:15.404735 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:15.407076 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:15.407110 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:15.408733 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:15.408745 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:15.409104 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:15.410048 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:15.410093 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:15.413034 (+ 2941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:15.417651 (+ 4617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:15.417672 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:15.417694 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:15.418406 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:15.419028 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:15.419034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:15.419038 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:15.419315 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:15.420200 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:15.420212 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:15.420711 (+ 499us) client_negotiation.cc:769] Sending connection context
0812 11:20:15.422603 (+ 1892us) client_negotiation.cc:240] Negotiation successful
0812 11:20:15.423310 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":368,"threads_started":1}
I20260812 11:20:15.427153 5240 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:15.427542 5240 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:15.428558 5240 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:15.431233 4689 ts_manager.cc:194] Registered new tserver with Master: 03c17cebf511455aa2219dbfce26f86d (127.15.164.194:43845)
I20260812 11:20:15.433763 4689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:42867
Aug 12 11:20:15 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:15.824642 5010 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:15.825139 5010 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:15.826779 4689 ts_manager.cc:194] Registered new tserver with Master: 3c55c7b6df6841c98e1c35e58857bc57 (127.15.164.193:35581)
I20260812 11:20:15.828076 4689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:50307
W20260812 11:20:15.917405 5244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:15.917824 5244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:15.917979 5244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:15.929320 5244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:15.929467 5244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:15.929648 5244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:15.944998 5244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.164.212:34593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:41513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=38579
--tserver_master_addrs=127.15.164.254:33789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:15.946853 5244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:15.948673 5244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:15.993799 5252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:16.002980 5256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:16.005044 5244 server_base.cc:1034] running on GCE node
W20260812 11:20:16.014918 5251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:16.017267 5244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:16.027020 5244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:16.042675 5244 hybrid_clock.cc:648] HybridClock initialized: now 1786533616042522 us; error 135 us; skew 500 ppm
I20260812 11:20:16.043216 5244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:16 dist-test-slave-7kzw krb5kdc[3104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:16.051316 5244 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:16.074954 5244 webserver.cc:460] Webserver started at http://127.15.164.195:38579/ using document root <none> and password file <none>
I20260812 11:20:16.076074 5244 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:16.076277 5244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:20:16 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:16.123111 5244 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.004s sys 0.000s
I20260812 11:20:16.140272 5269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:16.151137 5244 fs_manager.cc:725] Time spent opening block manager: real 0.026s user 0.015s sys 0.003s
I20260812 11:20:16.151373 5244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "f031b64bd8584cf4b7f78e4b9af35d29"
format_stamp: "Formatted at 2026-08-12 11:20:12 on dist-test-slave-7kzw"
server_key: "15d77e8a49600d213c7d4880871023e1"
server_key_iv: "9cbf11f6936d33616d414e04790525c9"
server_key_version: "kuduclusterkey@0"
I20260812 11:20:16.152776 5244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:16.215490 5244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:16.220818 5244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:16.221184 5244 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 12 11:20:16 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for HTTP/127.15.164.212@KRBTEST.COM
I20260812 11:20:16.237685 5244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:16.267688 5244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:16.267923 5244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:20:16.268115 5244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:16.268276 5244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:16.439471 5240 heartbeater.cc:503] Master 127.15.164.254:33789 was elected leader, sending a full tablet report...
I20260812 11:20:16.602931 5244 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:41513
I20260812 11:20:16.602995 5453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:41513 every 8 connection(s)
I20260812 11:20:16.604817 5244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:16.612015 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 5244
Aug 12 11:20:16 dist-test-slave-7kzw krb5kdc[3104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:16.666349 5465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.634770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:60905 (local address 127.15.164.254:33789)
0812 11:20:16.642689 (+ 7919us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.642698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.642725 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:20:16.643921 (+ 1196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.643927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.644094 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.644203 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:16.646983 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.648061 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.651764 (+ 3703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.652365 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.652476 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.656827 (+ 4351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:16.656833 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:16.656838 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:16.657051 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:16.660644 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.662637 (+ 1993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.662642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.662645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.662794 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.663335 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.663339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.663342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.663697 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:16.663834 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.665342 (+ 1508us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.665634 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6180,"spinlock_wait_cycles":18688,"thread_start_us":6684,"threads_started":1}
I20260812 11:20:16.671288 5464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.634042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:33789 (local address 127.15.164.195:60905)
0812 11:20:16.641418 (+ 7376us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.641464 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.643489 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.644624 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.644636 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.645362 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:16.646782 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.646810 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.648263 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.648268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.651581 (+ 3313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.651596 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.652803 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.652810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.653100 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.653966 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:16.653998 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:16.656553 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:16.661855 (+ 5302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:16.661864 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:16.661883 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:16.662491 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:16.662919 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:16.662923 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:16.662926 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:16.663195 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:16.663912 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:16.663921 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:16.664359 (+ 438us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.664658 (+ 299us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.666103 (+ 1445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7101,"thread_start_us":6276,"threads_started":1}
I20260812 11:20:16.672355 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.613341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33550 (local address 127.15.164.254:33789)
0812 11:20:16.623582 (+ 10241us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.623589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.645216 (+ 21627us) server_negotiation.cc:407] Connection header received
0812 11:20:16.645674 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.645679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.645756 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.645852 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:16.649157 (+ 3305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.650270 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.660716 (+ 10446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.661450 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.661570 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.665226 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:16.665232 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:16.665237 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:16.665310 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:16.668615 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.669973 (+ 1358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.669978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.669981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.670150 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.670619 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.670623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.670626 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.670947 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:16.671229 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.671786 (+ 557us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.672005 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10085,"spinlock_wait_cycles":896,"thread_start_us":9978,"threads_started":1}
I20260812 11:20:16.674326 5456 heartbeater.cc:347] Connected to a master server at 127.15.164.254:33789
I20260812 11:20:16.674690 5456 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:16.675599 5456 heartbeater.cc:511] Master 127.15.164.254:33789 requested a full tablet report, sending...
I20260812 11:20:16.677255 4689 ts_manager.cc:194] Registered new tserver with Master: f031b64bd8584cf4b7f78e4b9af35d29 (127.15.164.195:41513)
I20260812 11:20:16.678416 4689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:60905
I20260812 11:20:16.690152 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:16.711664 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.694446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33558 (local address 127.15.164.254:33789)
0812 11:20:16.694695 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.694701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.695252 (+ 551us) server_negotiation.cc:407] Connection header received
0812 11:20:16.695432 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.695438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.695545 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.695659 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:16.697718 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.698867 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.700725 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.701401 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.701546 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.704766 (+ 3220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:16.704774 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:16.704780 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:16.704825 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:16.708581 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.709389 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.709396 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.709400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.709576 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:16.710016 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:16.710022 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:16.710026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:16.710415 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:16.710717 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.711013 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.711291 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 11:20:16.718245 4689 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:20:16.730314 4689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:20:16.816061 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.749932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:43845 (local address 127.0.0.1:54222)
0812 11:20:16.794909 (+ 44977us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.794978 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.795208 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.800856 (+ 5648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.800863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.800911 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:16.801330 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.801343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.805419 (+ 4076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.805424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.809072 (+ 3648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.809090 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.815082 (+ 5992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.815089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.815321 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.815376 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.815524 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.815714 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44593,"thread_start_us":62887,"threads_started":1}
I20260812 11:20:16.819103 5498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.751645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.15.164.195:41513)
0812 11:20:16.780509 (+ 28864us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.780536 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.809738 (+ 29202us) server_negotiation.cc:407] Connection header received
0812 11:20:16.810022 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.810033 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.810345 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.810610 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:16.811697 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.813309 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.815783 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.817287 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.817456 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.817623 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.818561 (+ 938us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.818747 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28577,"thread_start_us":28910,"threads_started":1}
I20260812 11:20:16.819166 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.750598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54222 (local address 127.15.164.194:43845)
0812 11:20:16.798635 (+ 48037us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.798645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.799901 (+ 1256us) server_negotiation.cc:407] Connection header received
0812 11:20:16.800058 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.800068 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.800358 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.800557 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:16.801543 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.805157 (+ 3614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.813066 (+ 7909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.814536 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.814733 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.814914 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.818667 (+ 3753us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.818845 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47841,"thread_start_us":48071,"threads_started":1}
I20260812 11:20:16.820070 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.751300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:41513 (local address 127.0.0.1:58252)
0812 11:20:16.809599 (+ 58299us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.809625 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.809763 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.810949 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.810953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.810980 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:16.811435 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.811451 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.813498 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.813504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.815592 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.815608 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.818122 (+ 2514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.818128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.818311 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.818344 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.819586 (+ 1242us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.819736 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58168,"thread_start_us":44161,"threads_started":1}
I20260812 11:20:16.826155 5353 tablet_service.cc:1467] Processing CreateTablet for tablet 1312604c1032401eb96797b91e63eeaf (DEFAULT_TABLE table=test-table [id=929fef716f24421bb0fe634159a1e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:16.827301 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.750643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:35581 (local address 127.0.0.1:59294)
0812 11:20:16.803963 (+ 53320us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.803982 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.804090 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.811101 (+ 7011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.811109 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.811138 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:16.812707 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.812720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.821324 (+ 8604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.821329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.823210 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.823225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.826560 (+ 3335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.826566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.826725 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.826755 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.826835 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.826962 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53191,"thread_start_us":58709,"threads_started":1}
I20260812 11:20:16.828075 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.750888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.15.164.193:35581)
0812 11:20:16.810316 (+ 59428us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.810324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.810350 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:20:16.810445 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.810452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.810690 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.810872 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:16.816560 (+ 5688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.820964 (+ 4404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.823432 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.826046 (+ 2614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.826248 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.827558 (+ 1310us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.827641 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.827798 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59242,"thread_start_us":59100,"threads_started":1}
I20260812 11:20:16.827147 5135 tablet_service.cc:1467] Processing CreateTablet for tablet 1312604c1032401eb96797b91e63eeaf (DEFAULT_TABLE table=test-table [id=929fef716f24421bb0fe634159a1e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:16.829257 5353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1312604c1032401eb96797b91e63eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:16.830255 5135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1312604c1032401eb96797b91e63eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:16.831684 5010 heartbeater.cc:503] Master 127.15.164.254:33789 was elected leader, sending a full tablet report...
I20260812 11:20:16.831881 4893 tablet_service.cc:1467] Processing CreateTablet for tablet 1312604c1032401eb96797b91e63eeaf (DEFAULT_TABLE table=test-table [id=929fef716f24421bb0fe634159a1e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:16.833225 4893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1312604c1032401eb96797b91e63eeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:16.863276 5500 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Bootstrap starting.
I20260812 11:20:16.864835 5499 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Bootstrap starting.
I20260812 11:20:16.866349 5501 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Bootstrap starting.
I20260812 11:20:16.867159 5500 tablet_bootstrap.cc:654] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:16.868489 5500 log.cc:824] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:16.868533 5499 tablet_bootstrap.cc:654] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:16.869804 5499 log.cc:824] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:16.870500 5501 tablet_bootstrap.cc:654] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:16.871719 5501 log.cc:824] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:16.886792 5499 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: No bootstrap required, opened a new log
I20260812 11:20:16.887221 5499 ts_tablet_manager.cc:1397] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.000s
I20260812 11:20:16.894129 5500 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: No bootstrap required, opened a new log
I20260812 11:20:16.894454 5500 ts_tablet_manager.cc:1397] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.021s
I20260812 11:20:16.896262 5501 tablet_bootstrap.cc:492] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: No bootstrap required, opened a new log
I20260812 11:20:16.896718 5501 ts_tablet_manager.cc:1397] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.012s
I20260812 11:20:16.904328 5500 raft_consensus.cc:348] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.904855 5500 raft_consensus.cc:374] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:16.904953 5500 raft_consensus.cc:729] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c17cebf511455aa2219dbfce26f86d, State: Initialized, Role: FOLLOWER
I20260812 11:20:16.905821 5500 consensus_queue.cc:260] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.914393 5500 ts_tablet_manager.cc:1428] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Time spent starting tablet: real 0.020s user 0.010s sys 0.007s
I20260812 11:20:16.918275 5501 raft_consensus.cc:348] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.919003 5501 raft_consensus.cc:374] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:16.919176 5501 raft_consensus.cc:729] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c55c7b6df6841c98e1c35e58857bc57, State: Initialized, Role: FOLLOWER
I20260812 11:20:16.920070 5501 consensus_queue.cc:260] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.914377 5499 raft_consensus.cc:348] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.921228 5499 raft_consensus.cc:374] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:16.921391 5499 raft_consensus.cc:729] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f031b64bd8584cf4b7f78e4b9af35d29, State: Initialized, Role: FOLLOWER
I20260812 11:20:16.922123 5499 consensus_queue.cc:260] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.923385 5456 heartbeater.cc:503] Master 127.15.164.254:33789 was elected leader, sending a full tablet report...
I20260812 11:20:16.926178 5499 ts_tablet_manager.cc:1428] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Time spent starting tablet: real 0.039s user 0.015s sys 0.000s
I20260812 11:20:16.930511 5501 ts_tablet_manager.cc:1428] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Time spent starting tablet: real 0.034s user 0.009s sys 0.007s
I20260812 11:20:16.957597 5512 raft_consensus.cc:482] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:16.958092 5512 raft_consensus.cc:504] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.960403 5512 leader_election.cc:288] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03c17cebf511455aa2219dbfce26f86d (127.15.164.194:43845), 3c55c7b6df6841c98e1c35e58857bc57 (127.15.164.193:35581)
I20260812 11:20:16.968668 5464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.960813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:43845 (local address 127.15.164.195:46661)
0812 11:20:16.961340 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.961360 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.961485 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.962743 (+ 1258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.962748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.962780 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:16.962984 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.962995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.964368 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.964373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.966252 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.966276 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.967941 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.967949 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.968136 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.968169 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.968285 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.968415 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394}
I20260812 11:20:16.969560 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.961138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:46661 (local address 127.15.164.194:43845)
0812 11:20:16.961725 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.961731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.961750 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:20:16.961822 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.961827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.961908 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.961991 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:16.963165 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.964186 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.966495 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.967622 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.967773 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.967844 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.969199 (+ 1355us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.969340 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448}
I20260812 11:20:16.970616 5172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1312604c1032401eb96797b91e63eeaf" candidate_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17cebf511455aa2219dbfce26f86d" is_pre_election: true
I20260812 11:20:16.971252 5172 raft_consensus.cc:2454] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f031b64bd8584cf4b7f78e4b9af35d29 in term 0.
I20260812 11:20:16.972215 5274 leader_election.cc:302] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c17cebf511455aa2219dbfce26f86d, f031b64bd8584cf4b7f78e4b9af35d29; no voters:
I20260812 11:20:16.973970 5512 raft_consensus.cc:2781] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:16.974207 5512 raft_consensus.cc:482] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:16.974361 5512 raft_consensus.cc:3037] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:16.977933 5512 raft_consensus.cc:504] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:16.978797 5512 leader_election.cc:288] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [CANDIDATE]: Term 1 election: Requested vote from peers 03c17cebf511455aa2219dbfce26f86d (127.15.164.194:43845), 3c55c7b6df6841c98e1c35e58857bc57 (127.15.164.193:35581)
I20260812 11:20:16.979527 5172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1312604c1032401eb96797b91e63eeaf" candidate_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c17cebf511455aa2219dbfce26f86d"
I20260812 11:20:16.979815 5172 raft_consensus.cc:3037] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:16.980224 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.962351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:40183 (local address 127.15.164.193:35581)
0812 11:20:16.962615 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:16.962620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:16.972988 (+ 10368us) server_negotiation.cc:407] Connection header received
0812 11:20:16.973270 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:16.973276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:16.973364 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:16.973422 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:16.973992 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.975037 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.977336 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.978681 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.978820 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.978896 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:16.979789 (+ 893us) server_negotiation.cc:299] Negotiation successful
0812 11:20:16.979975 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:20:16.981012 5464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:16.961086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:35581 (local address 127.15.164.195:40183)
0812 11:20:16.972874 (+ 11788us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:16.972894 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:16.973108 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:16.973614 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:16.973618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:16.973641 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:16.973825 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.973835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.975236 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.975241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.977132 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:16.977148 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:16.979269 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:16.979275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:16.979495 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:16.979544 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 11:20:16.980537 (+ 993us) client_negotiation.cc:240] Negotiation successful
0812 11:20:16.980696 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11689,"thread_start_us":12560,"threads_started":1}
I20260812 11:20:16.982509 4932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1312604c1032401eb96797b91e63eeaf" candidate_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c55c7b6df6841c98e1c35e58857bc57"
I20260812 11:20:16.982538 4934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1312604c1032401eb96797b91e63eeaf" candidate_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c55c7b6df6841c98e1c35e58857bc57" is_pre_election: true
I20260812 11:20:16.983178 4934 raft_consensus.cc:2454] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f031b64bd8584cf4b7f78e4b9af35d29 in term 0.
I20260812 11:20:16.984556 5172 raft_consensus.cc:2454] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f031b64bd8584cf4b7f78e4b9af35d29 in term 1.
I20260812 11:20:16.985146 5274 leader_election.cc:302] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c17cebf511455aa2219dbfce26f86d, f031b64bd8584cf4b7f78e4b9af35d29; no voters:
I20260812 11:20:16.985533 5512 raft_consensus.cc:2781] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:16.992300 5512 raft_consensus.cc:686] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 1 LEADER]: Becoming Leader. State: Replica: f031b64bd8584cf4b7f78e4b9af35d29, State: Running, Role: LEADER
I20260812 11:20:16.992947 5512 consensus_queue.cc:237] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } }
I20260812 11:20:17.003252 4689 catalog_manager.cc:5495] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 reported cstate change: term changed from 0 to 1, leader changed from <none> to f031b64bd8584cf4b7f78e4b9af35d29 (127.15.164.195). New cstate: current_term: 1 leader_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f031b64bd8584cf4b7f78e4b9af35d29" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 } health_report { overall_health: UNKNOWN } } }
W20260812 11:20:17.035251 5011 tablet.cc:2369] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:17.055248 5498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:17.047747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.15.164.195:41513)
0812 11:20:17.047950 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:17.047956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:17.047977 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:20:17.048090 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:17.048095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:17.048203 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:17.048375 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:20:17.048855 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.050033 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.052030 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.052695 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.052834 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:17.053475 (+ 641us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:20:17.054229 (+ 754us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:20:17.054398 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:17.054555 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:20:17.054957 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:20:17.066695 4934 raft_consensus.cc:3037] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:17.066957 5172 raft_consensus.cc:1261] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 1 FOLLOWER]: Refusing update from remote peer f031b64bd8584cf4b7f78e4b9af35d29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:17.068251 5515 consensus_queue.cc:1035] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c17cebf511455aa2219dbfce26f86d" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:17.070369 4934 raft_consensus.cc:1261] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 1 FOLLOWER]: Refusing update from remote peer f031b64bd8584cf4b7f78e4b9af35d29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:17.072059 5515 consensus_queue.cc:1035] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c55c7b6df6841c98e1c35e58857bc57" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:17.102442 5519 mvcc.cc:205] Tried to move back new op lower bound from 7317641695491420160 to 7317641695207968768. Current Snapshot: MvccSnapshot[applied={T|T < 7317641695491420160}]
I20260812 11:20:17.135794 5521 mvcc.cc:205] Tried to move back new op lower bound from 7317641695491420160 to 7317641695207968768. Current Snapshot: MvccSnapshot[applied={T|T < 7317641695491420160}]
I20260812 11:20:17.146246 4689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:17.146600 4689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:17.151064 4689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b19ec66755124df9bff84a0a32f0f881: Sending DeleteTablet for 3 replicas of tablet 1312604c1032401eb96797b91e63eeaf
I20260812 11:20:17.152323 5135 tablet_service.cc:1514] Processing DeleteTablet for tablet 1312604c1032401eb96797b91e63eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:17 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:54222
I20260812 11:20:17.152884 5353 tablet_service.cc:1514] Processing DeleteTablet for tablet 1312604c1032401eb96797b91e63eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:17 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58252
I20260812 11:20:17.153383 4893 tablet_service.cc:1514] Processing DeleteTablet for tablet 1312604c1032401eb96797b91e63eeaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:17 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:59294
I20260812 11:20:17.163331 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 4751
I20260812 11:20:17.171145 5532 tablet_replica.cc:330] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: stopping tablet replica
I20260812 11:20:17.171356 5536 tablet_replica.cc:330] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: stopping tablet replica
I20260812 11:20:17.171701 5532 raft_consensus.cc:2229] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:17.171751 5536 raft_consensus.cc:2229] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:17.172308 5532 raft_consensus.cc:2258] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:17.172308 5536 raft_consensus.cc:2258] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:17.173692 5533 tablet_replica.cc:330] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: stopping tablet replica
I20260812 11:20:17.174072 5533 raft_consensus.cc:2229] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:20:17.174592 5532 ts_tablet_manager.cc:1905] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:17.174592 5536 ts_tablet_manager.cc:1905] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:17.174763 5533 raft_consensus.cc:2258] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:17.182605 5532 ts_tablet_manager.cc:1918] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:17.182833 5532 log.cc:1196] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/1312604c1032401eb96797b91e63eeaf
I20260812 11:20:17.182818 5536 ts_tablet_manager.cc:1918] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:17.182997 5536 log.cc:1196] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/1312604c1032401eb96797b91e63eeaf
I20260812 11:20:17.183681 5536 ts_tablet_manager.cc:1939] T 1312604c1032401eb96797b91e63eeaf P 3c55c7b6df6841c98e1c35e58857bc57: Deleting consensus metadata
I20260812 11:20:17.185765 4672 catalog_manager.cc:4841] TS 3c55c7b6df6841c98e1c35e58857bc57 (127.15.164.193:35581): tablet 1312604c1032401eb96797b91e63eeaf (table test-table [id=929fef716f24421bb0fe634159a1e805]) successfully deleted
I20260812 11:20:17.186635 5532 ts_tablet_manager.cc:1939] T 1312604c1032401eb96797b91e63eeaf P 03c17cebf511455aa2219dbfce26f86d: Deleting consensus metadata
I20260812 11:20:17.188506 4673 catalog_manager.cc:4841] TS 03c17cebf511455aa2219dbfce26f86d (127.15.164.194:43845): tablet 1312604c1032401eb96797b91e63eeaf (table test-table [id=929fef716f24421bb0fe634159a1e805]) successfully deleted
I20260812 11:20:17.191004 5533 ts_tablet_manager.cc:1905] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:17.194751 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:17.165548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59308 (local address 127.15.164.193:35581)
0812 11:20:17.165736 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:17.165742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:17.165760 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:20:17.165818 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:17.165824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:17.165901 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:17.166000 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:17.173014 (+ 7014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.174195 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.176345 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.177054 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.177185 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:17.181004 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:17.181022 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:17.181046 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:17.181097 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:17.189154 (+ 8057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.190207 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.190217 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.190220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.190392 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.190920 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.190925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.190928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.192465 (+ 1537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:17.192792 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:17.194028 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0812 11:20:17.194264 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:20:17.198717 5533 ts_tablet_manager.cc:1918] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:17.198904 5533 log.cc:1196] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/1312604c1032401eb96797b91e63eeaf
I20260812 11:20:17.199470 5533 ts_tablet_manager.cc:1939] T 1312604c1032401eb96797b91e63eeaf P f031b64bd8584cf4b7f78e4b9af35d29: Deleting consensus metadata
I20260812 11:20:17.199463 5002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:17.201485 4666 catalog_manager.cc:4841] TS f031b64bd8584cf4b7f78e4b9af35d29 (127.15.164.195:41513): tablet 1312604c1032401eb96797b91e63eeaf (table test-table [id=929fef716f24421bb0fe634159a1e805]) successfully deleted
I20260812 11:20:17.364884 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 4751
I20260812 11:20:17.397671 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 5017
I20260812 11:20:17.417461 5490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:17.398863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.15.164.194:43845)
0812 11:20:17.399432 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:17.399438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:17.399455 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:20:17.399515 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:17.399520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:17.399591 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:17.399702 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:17.401510 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.402674 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.404508 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.405177 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.405290 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:17.408826 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:17.408845 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:17.408868 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:17.408916 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:17.412722 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.413617 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.413628 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.413632 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.413799 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.414234 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.414238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.414241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.415205 (+ 964us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:17.415503 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:17.416666 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0812 11:20:17.416897 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449}
I20260812 11:20:17.418432 5234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:17.568892 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 5017
I20260812 11:20:17.606834 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 5244
I20260812 11:20:17.639212 5545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:17.608122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58276 (local address 127.15.164.195:41513)
0812 11:20:17.620746 (+ 12624us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:17.620753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:17.620782 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:20:17.620850 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:17.620854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:17.620939 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:17.623154 (+ 2215us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:17.623392 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.624621 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.626482 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:17.627191 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:17.630599 (+ 3408us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:17.630911 (+ 312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:17.630923 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:17.630946 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:17.630982 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:17.635045 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.635928 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.635935 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.635938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.636137 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:17.636570 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:17.636574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:17.636577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:17.637042 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:17.638430 (+ 1388us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:17.638608 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 11:20:17.638842 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12469,"thread_start_us":12935,"threads_started":1}
I20260812 11:20:17.640035 5448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:17.767401 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 5244
I20260812 11:20:17.800346 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 4634
I20260812 11:20:17.801781 4737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:17.918197 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 4634
I20260812 11:20:17.954190 16019 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:20:18.300437 16019 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:20:18.300702 16019 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:20:18.648053 16019 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:20:18.648 UTC [3155] LOG: received smart shutdown request
2026-08-12 11:20:18.652 UTC [3155] LOG: background worker "logical replication launcher" (PID 3166) exited with exit code 1
2026-08-12 11:20:18.652 UTC [3161] LOG: shutting down
2026-08-12 11:20:18.852 UTC [3155] LOG: database system is shut down
2026-08-12T11:20:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56517 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:19 dist-test-slave-7kzw krb5kdc[5563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:19 dist-test-slave-7kzw krb5kdc[5563](info): set up 2 sockets
Aug 12 11:20:19 dist-test-slave-7kzw krb5kdc[5563](info): commencing operation
krb5kdc: starting...
W20260812 11:20:20.378314 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.329s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:20:20 dist-test-slave-7kzw krb5kdc[5563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:20:20.677959 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40431
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:21.033622 5588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:21.033951 5588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:21.034047 5588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:21.041501 5588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:21.041627 5588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:21.041675 5588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:21.041729 5588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:21.041775 5588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:21.052161 5588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:40431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:21.053714 5588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:21.055138 5588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:21.067763 5602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:21.067713 5599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:21.068156 5596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:21.068912 5588 server_base.cc:1034] running on GCE node
I20260812 11:20:21.069837 5588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:21.071453 5588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:21.072714 5588 hybrid_clock.cc:648] HybridClock initialized: now 1786533621072669 us; error 52 us; skew 500 ppm
I20260812 11:20:21.073096 5588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:21.081985 5588 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:21.083714 5588 webserver.cc:460] Webserver started at http://127.15.164.254:33445/ using document root <none> and password file <none>
I20260812 11:20:21.084487 5588 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:21.084645 5588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:21.084980 5588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:21.088162 5588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "e5dfe5503b514f18bf0bae4eed678dec"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "d8c158f5fc56ecc0120f7ddb7a0aec0a"
server_key_iv: "914a41aa81e2a0d9919b631e4857f975"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.089017 5588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "e5dfe5503b514f18bf0bae4eed678dec"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "d8c158f5fc56ecc0120f7ddb7a0aec0a"
server_key_iv: "914a41aa81e2a0d9919b631e4857f975"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.094327 5588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:20:21.097822 5614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:21.099275 5588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:21.099483 5588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "e5dfe5503b514f18bf0bae4eed678dec"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "d8c158f5fc56ecc0120f7ddb7a0aec0a"
server_key_iv: "914a41aa81e2a0d9919b631e4857f975"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.099686 5588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:21.122051 5588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:21.126221 5588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:21.126588 5588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:21.146329 5588 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:40431
I20260812 11:20:21.146400 5684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:40431 every 8 connection(s)
I20260812 11:20:21.147842 5588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:21.151788 5686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:21.157074 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 5588
I20260812 11:20:21.157336 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:20:21.157994 16019 external_mini_cluster.cc:1428] Setting key f2eb72dfd67cc6ea382557f15020c620
I20260812 11:20:21.158835 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.164.253@KRBTEST.COM; defaulting to no policy
I20260812 11:20:21.183930 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.162160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40431 (local address 127.0.0.1:52162)
0812 11:20:21.163354 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.163435 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:21.165374 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:21.166338 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:21.166342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:21.166992 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:21.167404 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.167431 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.169278 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.169284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.171136 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.171155 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.172207 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.172220 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.172459 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.173229 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:21.173271 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:21.176035 (+ 2764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:21.179522 (+ 3487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.179535 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.179549 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.179989 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.180426 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.180430 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.180461 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.180634 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.181419 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:21.181426 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:21.181656 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 11:20:21.181909 (+ 253us) client_negotiation.cc:240] Negotiation successful
0812 11:20:21.182550 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":140,"thread_start_us":541,"threads_started":1}
I20260812 11:20:21.183969 5693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.162149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52162 (local address 127.15.164.254:40431)
0812 11:20:21.164084 (+ 1935us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:21.164095 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:21.164158 (+ 63us) server_negotiation.cc:407] Connection header received
0812 11:20:21.165772 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:21.165782 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:21.166066 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:21.166300 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:21.167679 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.169100 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.171313 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.171928 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.172079 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.176305 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:21.176314 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:21.176326 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:21.176360 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:21.179370 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.180143 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.180150 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.180152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.180309 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.180772 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.180776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.180778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.181277 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:21.181499 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:21.182051 (+ 552us) server_negotiation.cc:299] Negotiation successful
0812 11:20:21.182370 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1681,"spinlock_wait_cycles":49408,"thread_start_us":1463,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.253@KRBTEST.COM" created.
I20260812 11:20:21.187036 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:20:21.188042 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.187650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46922)
0812 11:20:21.187819 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.187934 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 11:20:21.188328 5620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
I20260812 11:20:21.190037 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.189547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46930)
0812 11:20:21.189751 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.189849 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 11:20:21.190260 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:35539: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
I20260812 11:20:21.220108 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:35539
--webserver_interface=127.15.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:21.239809 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } attempt: 1
I20260812 11:20:21.241226 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.240721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46934)
0812 11:20:21.240945 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.241083 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 11:20:21.242249 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.241894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46938)
0812 11:20:21.242043 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.242121 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:20:21.242442 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:35539: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
I20260812 11:20:21.310784 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } attempt: 2
I20260812 11:20:21.312312 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.311740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46948)
0812 11:20:21.312053 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.312160 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 11:20:21.313458 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.313024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46964)
0812 11:20:21.313233 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.313313 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260812 11:20:21.313709 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:35539: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
I20260812 11:20:21.404975 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } attempt: 3
I20260812 11:20:21.406276 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.405760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46966)
0812 11:20:21.405990 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.406123 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 11:20:21.407477 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.407057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46970)
0812 11:20:21.407237 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.407320 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 11:20:21.407692 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:35539: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
I20260812 11:20:21.550978 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } attempt: 4
I20260812 11:20:21.552366 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.551764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46978)
0812 11:20:21.552113 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.552214 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260812 11:20:21.553534 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.553117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46986)
0812 11:20:21.553301 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.553398 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:20:21.553745 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:35539: Network error: Client connection negotiation failed: client connection to 127.15.164.253:35539: connect: Connection refused (error 111)
W20260812 11:20:21.569798 5701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:21.570228 5701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:21.570474 5701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:21.578083 5701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:21.578193 5701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:21.578240 5701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:21.578426 5701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:21.578580 5701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:21.588670 5701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:35539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:21.589964 5701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:21.591356 5701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:21.606304 5711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:21.606483 5710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:21.606506 5713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:21.607286 5701 server_base.cc:1034] running on GCE node
I20260812 11:20:21.608211 5701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:21.609752 5701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:21.610965 5701 hybrid_clock.cc:648] HybridClock initialized: now 1786533621610896 us; error 60 us; skew 500 ppm
I20260812 11:20:21.611357 5701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:21.614770 5701 init.cc:377] Logged in from keytab as kudu/127.15.164.253@KRBTEST.COM (short username kudu)
I20260812 11:20:21.616509 5701 webserver.cc:460] Webserver started at http://127.15.164.253:38155/ using document root <none> and password file <none>
I20260812 11:20:21.617257 5701 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:21.617408 5701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:21.617753 5701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:21.620925 5701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data/instance:
uuid: "e66db8ba06044d5e8c64353aad426f89"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "1760e54281df99879c2aacdcfa072b41"
server_key_iv: "67e928c2ec8dd1d4bc962378d82c9376"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.621773 5701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal/instance:
uuid: "e66db8ba06044d5e8c64353aad426f89"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "1760e54281df99879c2aacdcfa072b41"
server_key_iv: "67e928c2ec8dd1d4bc962378d82c9376"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.627094 5701 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:20:21.630771 5726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:21.632107 5701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:21.632308 5701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "e66db8ba06044d5e8c64353aad426f89"
format_stamp: "Formatted at 2026-08-12 11:20:21 on dist-test-slave-7kzw"
server_key: "1760e54281df99879c2aacdcfa072b41"
server_key_iv: "67e928c2ec8dd1d4bc962378d82c9376"
server_key_version: "encryptionkey@0"
I20260812 11:20:21.632514 5701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:21.644480 5701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:21.648746 5701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:21.649044 5701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:21.673770 5701 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.253:35539
I20260812 11:20:21.673790 5812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.253:35539 every 8 connection(s)
I20260812 11:20:21.675257 5701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
I20260812 11:20:21.677809 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 5701
I20260812 11:20:21.678051 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-1/wal/instance
I20260812 11:20:21.678709 16019 external_mini_cluster.cc:1428] Setting key 3d4acf68abf5b3adb60086f6d02d016b
I20260812 11:20:21.680017 5813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:21.691107 5813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.252@KRBTEST.COM" created.
I20260812 11:20:21.714941 5817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.694065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.15.164.254:40431)
0812 11:20:21.694726 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:21.694735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:21.695801 (+ 1066us) server_negotiation.cc:407] Connection header received
0812 11:20:21.697873 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:21.697882 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:21.697991 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:21.698157 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:21.699845 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.701268 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.703188 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.704129 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.704307 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.708206 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:21.708211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:21.708215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:21.708255 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:21.711263 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.712374 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.712378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.712380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.712499 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.713026 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.713029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.713031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.713293 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:21.713413 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:21.714426 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0812 11:20:21.714650 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":308,"threads_started":1}
I20260812 11:20:21.716656 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.694707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40431 (local address 127.0.0.1:52166)
0812 11:20:21.695596 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.695658 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:21.697570 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:21.698392 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:21.698400 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:21.699027 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:21.699631 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.699650 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.701451 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.701455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.703029 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.703044 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.704396 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.704403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.704598 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.705317 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:21.705340 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:21.707933 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:21.711427 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.711442 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.711463 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.712237 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.712615 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.712623 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.712629 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.712901 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.713448 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:21.713460 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:21.713979 (+ 519us) client_negotiation.cc:769] Sending connection context
0812 11:20:21.714337 (+ 358us) client_negotiation.cc:240] Negotiation successful
0812 11:20:21.714970 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":387,"threads_started":1}
I20260812 11:20:21.718650 5813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:20:21.737690 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.719403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46990)
0812 11:20:21.719659 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.719681 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:21.719785 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:21.721002 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:21.721006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:21.721554 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:21.721782 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.721795 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.723288 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.723296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.724888 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.724907 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.725741 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.725751 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.725984 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.726900 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:21.726929 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:21.729555 (+ 2626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:21.734379 (+ 4824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.734383 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.734386 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.734976 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.735525 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.735529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.735531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.735799 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.736557 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:21.736565 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:21.736731 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 11:20:21.736901 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 11:20:21.737224 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 11:20:21.737735 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.719743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46990 (local address 127.15.164.253:35539)
0812 11:20:21.720421 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:21.720432 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:21.720470 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:20:21.720556 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:21.720567 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:21.720811 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:21.720982 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:21.721973 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.723133 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.725038 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.725558 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.725653 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.729796 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:21.729813 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:21.729835 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:21.729885 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:21.734197 (+ 4312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.735130 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.735140 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.735145 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.735302 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.735925 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.735933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.735936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.736426 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:21.736658 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:21.737064 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:20:21.737330 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":310,"threads_started":1}
I20260812 11:20:21.740993 5813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:20:21.742456 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.741911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:41970)
0812 11:20:21.742166 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.742281 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 11:20:21.742869 5730 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.744626 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.744252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:41974)
0812 11:20:21.744431 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.744518 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:20:21.744954 5813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
I20260812 11:20:21.748600 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:42327
--webserver_interface=127.15.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:21.794330 5813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 1
I20260812 11:20:21.795874 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.795262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:41982)
0812 11:20:21.795479 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.795616 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:20:21.797382 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.796820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:41984)
0812 11:20:21.797098 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.797212 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:20:21.798610 5813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.853016 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } attempt: 5
Aug 12 11:20:21 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:20:21.866940 5813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 2
I20260812 11:20:21.868026 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.867524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42000)
0812 11:20:21.867713 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.867838 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:20:21.868942 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.853856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:46996)
0812 11:20:21.854092 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.854130 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:21.854278 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:21.854697 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:21.854701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:21.855167 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:21.855431 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.855445 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.857051 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.857056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.858018 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:21.858040 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.858988 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.858994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:21.859141 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.859878 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:21.859910 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:21.862121 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:21.866045 (+ 3924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.866050 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.866053 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.866518 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.866972 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:21.866978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:21.866982 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:21.867164 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:21.867871 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:21.867876 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:21.868070 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 11:20:21.868235 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 11:20:21.868568 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:20:21.869413 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.853941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46996 (local address 127.15.164.253:35539)
0812 11:20:21.854097 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:21.854104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:21.854194 (+ 90us) server_negotiation.cc:407] Connection header received
0812 11:20:21.854432 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:21.854437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:21.854541 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:21.854662 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:21.855655 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.856869 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.858191 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:21.858837 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:21.858971 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:21.862338 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:21.862345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:21.862350 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:21.862391 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:21.865868 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.866651 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.866656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.866660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.866815 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:21.867286 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:21.867291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:21.867295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:21.867718 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:21.867861 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:21.868735 (+ 874us) server_negotiation.cc:299] Negotiation successful
0812 11:20:21.868983 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:20:21.869462 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.868834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42012)
0812 11:20:21.869156 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.869258 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260812 11:20:21.869876 5813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.870735 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:20:21.871848 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.871443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42028)
0812 11:20:21.871639 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.871713 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 11:20:21.872879 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.872483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42042)
0812 11:20:21.872704 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.872778 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 11:20:21.873095 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.924360 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 1
I20260812 11:20:21.925808 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.925259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42052)
0812 11:20:21.925501 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.925614 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 11:20:21.926997 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.926630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42064)
0812 11:20:21.926809 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.926890 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 11:20:21.927225 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.961194 5813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 3
I20260812 11:20:21.962800 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.962075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42070)
0812 11:20:21.962373 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.962548 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 11:20:21.964169 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.963578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42082)
0812 11:20:21.963868 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.963981 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260812 11:20:21.964458 5813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:21.995487 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 2
I20260812 11:20:21.996794 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.996231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42090)
0812 11:20:21.996493 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.996581 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 11:20:21.997799 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:21.997466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42096)
0812 11:20:21.997615 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:21.997696 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:20:21.998003 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:22.104243 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 3
I20260812 11:20:22.105708 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.105075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42108)
0812 11:20:22.105354 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.105480 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 11:20:22.106925 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.106442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42112)
0812 11:20:22.106668 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.106771 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260812 11:20:22.107169 5686 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
I20260812 11:20:22.107709 5813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 4
I20260812 11:20:22.108841 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.108287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42116)
0812 11:20:22.108535 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.108642 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:20:22.109989 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.109583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42122)
0812 11:20:22.109769 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.109859 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 11:20:22.110231 5813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:42327: Network error: Client connection negotiation failed: client connection to 127.15.164.252:42327: connect: Connection refused (error 111)
W20260812 11:20:22.120012 5824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:22.120303 5824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:22.120497 5824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:22.128026 5824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:22.128130 5824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:22.128232 5824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:22.128336 5824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:22.128418 5824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:22.138712 5824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:40431,127.15.164.253:35539,127.15.164.252:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:42327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:22.140134 5824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:22.141501 5824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:22.154204 5833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:22.154232 5835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:22.155012 5832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:22.159307 5824 server_base.cc:1034] running on GCE node
I20260812 11:20:22.160188 5824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:22.161679 5824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:22.162912 5824 hybrid_clock.cc:648] HybridClock initialized: now 1786533622162867 us; error 61 us; skew 500 ppm
I20260812 11:20:22.163280 5824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533622, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:22.166538 5824 init.cc:377] Logged in from keytab as kudu/127.15.164.252@KRBTEST.COM (short username kudu)
I20260812 11:20:22.168149 5824 webserver.cc:460] Webserver started at http://127.15.164.252:36075/ using document root <none> and password file <none>
I20260812 11:20:22.168905 5824 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:22.169059 5824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:22.169380 5824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:22.172868 5824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data/instance:
uuid: "ca2126a477a444b6ac1781ebaa90c84a"
format_stamp: "Formatted at 2026-08-12 11:20:22 on dist-test-slave-7kzw"
server_key: "e0ebb6082c007c103cb6876b2c2cc89c"
server_key_iv: "a7906afe7b45c9dc3913cc543639187a"
server_key_version: "encryptionkey@0"
I20260812 11:20:22.173851 5824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal/instance:
uuid: "ca2126a477a444b6ac1781ebaa90c84a"
format_stamp: "Formatted at 2026-08-12 11:20:22 on dist-test-slave-7kzw"
server_key: "e0ebb6082c007c103cb6876b2c2cc89c"
server_key_iv: "a7906afe7b45c9dc3913cc543639187a"
server_key_version: "encryptionkey@0"
I20260812 11:20:22.180116 5824 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 11:20:22.183987 5846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:22.185421 5824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:22.185647 5824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "ca2126a477a444b6ac1781ebaa90c84a"
format_stamp: "Formatted at 2026-08-12 11:20:22 on dist-test-slave-7kzw"
server_key: "e0ebb6082c007c103cb6876b2c2cc89c"
server_key_iv: "a7906afe7b45c9dc3913cc543639187a"
server_key_version: "encryptionkey@0"
I20260812 11:20:22.185873 5824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:22.202441 5824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:22.208305 5824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:22.208636 5824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:22.227702 5824 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.252:42327
I20260812 11:20:22.227707 5930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.252:42327 every 8 connection(s)
I20260812 11:20:22.229156 5824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
I20260812 11:20:22.233314 5931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:22.237686 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 5824
I20260812 11:20:22.237931 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786533397360424-16019-0/minicluster-data/master-2/wal/instance
I20260812 11:20:22.238540 16019 external_mini_cluster.cc:1428] Setting key cac19c22062a563a169cad410606e2b6
I20260812 11:20:22.241719 5931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533622, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:22.264983 5939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.246359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52176 (local address 127.15.164.254:40431)
0812 11:20:22.247817 (+ 1458us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.247822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.247840 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:20:22.247892 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.247896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.247964 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.248059 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.249610 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.250893 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.253093 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.253846 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.254011 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.258596 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.258602 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.258606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.258660 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.261576 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.262367 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.262371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.262374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.262574 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.263030 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.263036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.263040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.263363 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.263577 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.264235 (+ 658us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.264521 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1329,"thread_start_us":1252,"threads_started":1}
I20260812 11:20:22.266049 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.246224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:40431 (local address 127.0.0.1:52176)
0812 11:20:22.247032 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.247097 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:22.247302 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:22.248179 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:22.248187 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:22.249045 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:22.249449 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.249460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.251066 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.251070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.252896 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.252912 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.254107 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.254113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.254248 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.255007 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:22.255031 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:22.258324 (+ 3293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:22.261766 (+ 3442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.261776 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.261787 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.262209 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.262697 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.262704 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.262708 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.262901 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.263538 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:22.263546 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:22.263804 (+ 258us) client_negotiation.cc:769] Sending connection context
0812 11:20:22.264185 (+ 381us) client_negotiation.cc:240] Negotiation successful
0812 11:20:22.264760 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":1,"thread_start_us":334,"threads_started":1}
I20260812 11:20:22.266172 5935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.240648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42130 (local address 127.15.164.252:42327)
0812 11:20:22.241577 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.241590 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.241637 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:20:22.243994 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.244021 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.244502 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.244858 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.247060 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.249124 (+ 2064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.251334 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.252564 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.252819 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.258000 (+ 5181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.258012 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.258037 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.258089 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.261552 (+ 3463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.262335 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.262346 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.262351 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.262597 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.263066 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.263070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.263072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.263825 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.264058 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.264567 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.264917 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":130,"server-negotiator.queue_time_us":699,"thread_start_us":443,"threads_started":1}
I20260812 11:20:22.268819 5931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533622, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:22.284125 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.269878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.15.164.253:35539)
0812 11:20:22.270286 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.270291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.270307 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:20:22.270355 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.270359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.270442 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.270617 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.271404 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.272081 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.273277 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.273864 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.274138 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.277676 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.277681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.277685 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.277717 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.281122 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.281837 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.281842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.281845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.281998 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.282400 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.282405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.282408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.282825 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.282943 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.283521 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.283805 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
I20260812 11:20:22.284129 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.269711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:35539 (local address 127.0.0.1:47000)
0812 11:20:22.269909 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.269931 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:22.270049 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:22.270688 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:22.270693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:22.271073 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:22.271247 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.271256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.272227 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.272234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.273110 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.273121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.274131 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.274138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.274385 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.275209 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:22.275240 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:22.277451 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:22.281286 (+ 3835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.281290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.281293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.281700 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.282122 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.282125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.282128 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.282285 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.282963 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:22.282970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:22.283173 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 11:20:22.283435 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 11:20:22.283746 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:20:22.284394 5686 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 4
I20260812 11:20:22.286060 5939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.270076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52186 (local address 127.15.164.254:40431)
0812 11:20:22.270521 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.270527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.270550 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:20:22.270615 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.270620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.270699 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.270806 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.272016 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.272687 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.274043 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.274532 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.274665 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.279208 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.279216 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.279222 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.279268 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.282637 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.283631 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.283636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.283639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.283796 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.284306 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.284312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.284316 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.284724 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.285088 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.285470 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.285722 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260812 11:20:22.286557 5931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533622, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:20:22.302222 5935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.285399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.15.164.252:42327)
0812 11:20:22.285546 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.285551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.285569 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:20:22.285613 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.285618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.285682 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.286805 (+ 1123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.286969 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.288130 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.290300 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.291037 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.291192 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.295051 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.295056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.295060 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.295092 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.298872 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.299719 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.299727 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.299732 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.299902 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.300397 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.300404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.300410 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.300809 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.300970 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.301534 (+ 564us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.301848 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:20:22.302248 5691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.285022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42142)
0812 11:20:22.285200 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.285220 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:22.285331 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:22.285850 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:22.285855 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:22.286386 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:22.286645 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.286658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.288312 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.288318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.289993 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.290010 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.291215 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.291221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.291411 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.291993 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:22.292016 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:22.294846 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:22.299030 (+ 4184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.299035 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.299040 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.299537 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.300046 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.300055 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.300062 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.300244 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.300976 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:22.300984 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:22.301208 (+ 224us) client_negotiation.cc:769] Sending connection context
0812 11:20:22.301407 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 11:20:22.301728 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:20:22.305523 5938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.287482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42146)
0812 11:20:22.287700 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.287722 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:22.287826 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:22.289616 (+ 1790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:22.289621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:22.290164 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:22.290339 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.290349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.292385 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.292394 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.293296 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.293308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.294403 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.294409 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.294685 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.295613 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:22.295636 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:22.298527 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:22.302380 (+ 3853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.302387 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.302393 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.302911 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.303380 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.303385 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.303389 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.303556 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.304400 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:22.304407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:22.304567 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 11:20:22.304754 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:20:22.305069 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 11:20:22.305828 5940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.287684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42146 (local address 127.15.164.252:42327)
0812 11:20:22.289315 (+ 1631us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.289321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.289344 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:20:22.289391 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.289398 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.289461 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.290546 (+ 1085us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.290898 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.292245 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.293491 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.294235 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.294373 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.298756 (+ 4383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.298761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.298764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.298790 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.302214 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.303084 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.303087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.303089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.303209 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.303754 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.303760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.303764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.304248 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.304415 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.304851 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.305286 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":178,"server-negotiator.queue_time_us":1488,"thread_start_us":1271,"threads_started":1}
I20260812 11:20:22.307716 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.288193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47008 (local address 127.15.164.253:35539)
0812 11:20:22.288395 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.288401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.288669 (+ 268us) server_negotiation.cc:407] Connection header received
0812 11:20:22.288840 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.288848 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.288944 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.289039 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.290604 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.291871 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.293646 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.294080 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.294233 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.299936 (+ 5703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.299940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.299944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.300005 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.303769 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.304670 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.304677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.304681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.304880 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.305341 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.305348 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.305351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.306326 (+ 975us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.306692 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.307032 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.307309 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 11:20:22.310109 5686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: Bootstrap starting.
I20260812 11:20:22.311714 5931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: Bootstrap starting.
I20260812 11:20:22.313817 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:20:22.313952 5686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:22.315135 5686 log.cc:824] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:22.315652 5931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:22.317003 5931 log.cc:824] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:22.318746 5686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: No bootstrap required, opened a new log
I20260812 11:20:22.320595 5931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: No bootstrap required, opened a new log
I20260812 11:20:22.335848 5931 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.336407 5931 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:22.336692 5931 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca2126a477a444b6ac1781ebaa90c84a, State: Initialized, Role: FOLLOWER
I20260812 11:20:22.337615 5931 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.339521 5686 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.340116 5686 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:22.340276 5686 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5dfe5503b514f18bf0bae4eed678dec, State: Initialized, Role: FOLLOWER
I20260812 11:20:22.346282 5956 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.346458 5686 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.346859 5956 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.349156 5931 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:22.355911 5957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.356736 5957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.357064 5957 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:22.357482 5957 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.359180 5940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.322138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42160 (local address 127.15.164.252:42327)
0812 11:20:22.322343 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.322352 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.332962 (+ 10610us) server_negotiation.cc:407] Connection header received
0812 11:20:22.333587 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.333594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.333693 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.333783 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.337132 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.338278 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.341463 (+ 3185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.342543 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.342693 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.348874 (+ 6181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.348883 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.348888 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.348933 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.354000 (+ 5067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.355735 (+ 1735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.355746 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.355752 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.355969 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.356625 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.356632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.356637 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.357135 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.357486 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.358274 (+ 788us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.358580 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:20:22.360239 5957 leader_election.cc:288] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e66db8ba06044d5e8c64353aad426f89 (127.15.164.253:35539), ca2126a477a444b6ac1781ebaa90c84a (127.15.164.252:42327)
I20260812 11:20:22.362488 5686 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:22.361369 5886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5dfe5503b514f18bf0bae4eed678dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca2126a477a444b6ac1781ebaa90c84a" is_pre_election: true
I20260812 11:20:22.368230 5886 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5dfe5503b514f18bf0bae4eed678dec in term 0.
I20260812 11:20:22.369308 5615 leader_election.cc:302] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca2126a477a444b6ac1781ebaa90c84a, e5dfe5503b514f18bf0bae4eed678dec; no voters:
I20260812 11:20:22.369853 5957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:22.370020 5939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.321727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.15.164.254:40431)
0812 11:20:22.321907 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.321914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.335225 (+ 13311us) server_negotiation.cc:407] Connection header received
0812 11:20:22.335568 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.335578 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.335697 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.335821 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.340905 (+ 5084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.342611 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.347329 (+ 4718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.348355 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.348504 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.356751 (+ 8247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.356771 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.356777 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.356827 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.363225 (+ 6398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.364746 (+ 1521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.364753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.364772 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.364985 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.365574 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.365581 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.365585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.366029 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.367912 (+ 1883us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.368055 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.368324 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:20:22.372232 5957 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:22.372404 5957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:22.376379 5957 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.377900 5957 leader_election.cc:288] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [CANDIDATE]: Term 1 election: Requested vote from peers e66db8ba06044d5e8c64353aad426f89 (127.15.164.253:35539), ca2126a477a444b6ac1781ebaa90c84a (127.15.164.252:42327)
I20260812 11:20:22.378664 5886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5dfe5503b514f18bf0bae4eed678dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca2126a477a444b6ac1781ebaa90c84a"
I20260812 11:20:22.378978 5886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:20:22.379597 5623 tablet.cc:2369] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:22.383685 5886 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5dfe5503b514f18bf0bae4eed678dec in term 1.
I20260812 11:20:22.384390 5615 leader_election.cc:302] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca2126a477a444b6ac1781ebaa90c84a, e5dfe5503b514f18bf0bae4eed678dec; no voters:
I20260812 11:20:22.384851 5957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:22.385063 5957 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [term 1 LEADER]: Becoming Leader. State: Replica: e5dfe5503b514f18bf0bae4eed678dec, State: Running, Role: LEADER
I20260812 11:20:22.386096 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.335401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47016 (local address 127.15.164.253:35539)
0812 11:20:22.335637 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.335644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.355580 (+ 19936us) server_negotiation.cc:407] Connection header received
0812 11:20:22.364240 (+ 8660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.364251 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.364358 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.364465 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.366303 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.367602 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.371126 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.371870 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.372022 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.375832 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.375839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.375846 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.375894 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.380505 (+ 4611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.381724 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.381733 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.381740 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.381977 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.382610 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.382616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.382621 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.383171 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.385037 (+ 1866us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.385224 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.385550 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 11:20:22.385869 5957 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.399309 5960 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5dfe5503b514f18bf0bae4eed678dec. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.400028 5960 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:22.405200 5984 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:22.409463 5813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } attempt: 5
W20260812 11:20:22.412299 5993 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:20:22.414008 5993 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 11:20:22 dist-test-slave-7kzw krb5kdc[5563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533621, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
I20260812 11:20:22.416703 5588 master_runner.cc:186] Error getting master registration for 127.15.164.253:35539: OK, instance_id { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" instance_seqno: 1786533621667213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:20:22.458871 5588 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:20:22.461073 5854 tablet.cc:2369] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:22.463387 5984 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:22.467173 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.410232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:42327 (local address 127.0.0.1:42172)
0812 11:20:22.410861 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:22.410884 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:22.411007 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:22.413906 (+ 2899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:22.413911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:22.414589 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:22.414842 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.414857 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.418628 (+ 3771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.418639 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.420859 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:22.420884 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.427835 (+ 6951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.427851 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:22.428886 (+ 1035us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.430831 (+ 1945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:22.430966 (+ 135us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:22.444967 (+ 14001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:22.452674 (+ 7707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.452682 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.452737 (+ 55us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.454812 (+ 2075us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.457167 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:22.457173 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:22.457177 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:22.457905 (+ 728us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:22.461492 (+ 3587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:22.461497 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:22.462190 (+ 693us) client_negotiation.cc:769] Sending connection context
0812 11:20:22.466270 (+ 4080us) client_negotiation.cc:240] Negotiation successful
0812 11:20:22.466706 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466}
I20260812 11:20:22.468351 5940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:22.410621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42172 (local address 127.15.164.252:42327)
0812 11:20:22.411243 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:22.411250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:22.411269 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:20:22.411339 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:22.411345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:22.411428 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:22.411549 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:22.415093 (+ 3544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.416420 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.421195 (+ 4775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:22.422272 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:22.422452 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:22.445388 (+ 22936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:22.445398 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:22.445404 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:22.445454 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:22.452039 (+ 6585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.455322 (+ 3283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.455331 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.455335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.456062 (+ 727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:22.458342 (+ 2280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:22.458350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:22.458354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:22.460378 (+ 2024us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:22.461095 (+ 717us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:22.464163 (+ 3068us) server_negotiation.cc:299] Negotiation successful
0812 11:20:22.466099 (+ 1936us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495}
I20260812 11:20:22.491974 5813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: Bootstrap starting.
I20260812 11:20:22.495486 5886 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [term 1 FOLLOWER]: Refusing update from remote peer e5dfe5503b514f18bf0bae4eed678dec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:22.496510 5960 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:22.524555 5813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:22.531694 5813 log.cc:824] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:22.472138 5824 master_runner.cc:186] Error getting master registration for 127.15.164.253:35539: OK, instance_id { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" instance_seqno: 1786533621667213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:20:22.537876 5824 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:20:22.548911 5813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: No bootstrap required, opened a new log
I20260812 11:20:22.555639 5956 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5dfe5503b514f18bf0bae4eed678dec. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.556015 5956 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.562919 6001 mvcc.cc:205] Tried to move back new op lower bound from 7317641717729751040 to 7317641717298909184. Current Snapshot: MvccSnapshot[applied={T|T < 7317641717729751040}]
I20260812 11:20:22.572878 5956 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.573179 5956 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.579180 5960 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.580066 5960 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:22.582336 5984 catalog_manager.cc:1347] Generated new cluster ID: 78b568f70090425a8a3a9988961d45cf
I20260812 11:20:22.582481 5984 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:22.588795 5813 raft_consensus.cc:348] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.589524 5813 raft_consensus.cc:374] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:22.589727 5813 raft_consensus.cc:729] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e66db8ba06044d5e8c64353aad426f89, State: Initialized, Role: FOLLOWER
I20260812 11:20:22.595494 5813 consensus_queue.cc:260] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } }
I20260812 11:20:22.606088 5984 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:22.610945 5984 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:22.613607 5813 sys_catalog.cc:564] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:22.614074 5770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:22.618059 5770 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 1 FOLLOWER]: Refusing update from remote peer e5dfe5503b514f18bf0bae4eed678dec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:22.618549 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5dfe5503b514f18bf0bae4eed678dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66db8ba06044d5e8c64353aad426f89"
I20260812 11:20:22.622221 5771 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5dfe5503b514f18bf0bae4eed678dec in term 1.
I20260812 11:20:22.613643 5776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5dfe5503b514f18bf0bae4eed678dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e66db8ba06044d5e8c64353aad426f89" is_pre_election: true
I20260812 11:20:22.623791 5776 raft_consensus.cc:2362] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5dfe5503b514f18bf0bae4eed678dec in term 1. Re-sending same reply.
I20260812 11:20:22.624390 6006 sys_catalog.cc:455] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.624859 6006 sys_catalog.cc:458] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.625016 5960 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:22.650957 5984 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec: Generated new TSK 0
I20260812 11:20:22.653152 5984 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:20:22.687675 6006 sys_catalog.cc:455] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5dfe5503b514f18bf0bae4eed678dec. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.688057 6006 sys_catalog.cc:458] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.687709 6013 sys_catalog.cc:455] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.688215 6013 sys_catalog.cc:458] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:20:22.688473 5957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5dfe5503b514f18bf0bae4eed678dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5dfe5503b514f18bf0bae4eed678dec" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 40431 } } peers { permanent_uuid: "e66db8ba06044d5e8c64353aad426f89" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 35539 } } peers { permanent_uuid: "ca2126a477a444b6ac1781ebaa90c84a" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 42327 } } }
I20260812 11:20:22.688827 5957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5dfe5503b514f18bf0bae4eed678dec [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:22.761718 6030 catalog_manager.cc:1259] Loaded cluster ID: 78b568f70090425a8a3a9988961d45cf
I20260812 11:20:22.761843 6030 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: loading cluster ID for follower catalog manager: success
I20260812 11:20:22.765748 6030 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: acquiring CA information for follower catalog manager: success
I20260812 11:20:22.773779 6030 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e66db8ba06044d5e8c64353aad426f89: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:20:23.416693 5993 catalog_manager.cc:1259] Loaded cluster ID: 78b568f70090425a8a3a9988961d45cf
I20260812 11:20:23.416868 5993 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: loading cluster ID for follower catalog manager: success
I20260812 11:20:23.419636 5993 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: acquiring CA information for follower catalog manager: success
I20260812 11:20:23.421627 5993 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ca2126a477a444b6ac1781ebaa90c84a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:20:23.806507 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 5588
I20260812 11:20:23.808128 5679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:23.923159 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 5588
I20260812 11:20:23.961673 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 5701
I20260812 11:20:23.963042 5808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:24.070382 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 5701
I20260812 11:20:24.101364 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 5824
I20260812 11:20:24.102576 5923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:24.211973 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 5824
2026-08-12T11:20:24Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5214 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:24 dist-test-slave-7kzw krb5kdc[6040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:24 dist-test-slave-7kzw krb5kdc[6040](info): set up 2 sockets
Aug 12 11:20:24 dist-test-slave-7kzw krb5kdc[6040](info): commencing operation
krb5kdc: starting...
W20260812 11:20:25.624161 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.361s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:20:25 dist-test-slave-7kzw krb5kdc[6040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:20:25.919133 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33009
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:37761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:33009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:26.305131 6060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:26.305462 6060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:26.305639 6060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:26.313259 6060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:26.313380 6060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:26.313485 6060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:26.313591 6060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:26.313678 6060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:26.324036 6060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:37761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:33009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:26.325433 6060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:26.326875 6060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:26.339231 6066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:26.339272 6069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:26.339200 6071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:26.340183 6060 server_base.cc:1034] running on GCE node
I20260812 11:20:26.341097 6060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:26.342773 6060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:26.344061 6060 hybrid_clock.cc:648] HybridClock initialized: now 1786533626343994 us; error 44 us; skew 500 ppm
I20260812 11:20:26.344508 6060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:26 dist-test-slave-7kzw krb5kdc[6040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533626, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:26.348268 6060 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:26.350054 6060 webserver.cc:460] Webserver started at http://127.15.164.254:38615/ using document root <none> and password file <none>
I20260812 11:20:26.350968 6060 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:26.351146 6060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:26.351513 6060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:26.354990 6060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "823e2cd2444c4ecba484583c0981fb71"
format_stamp: "Formatted at 2026-08-12 11:20:26 on dist-test-slave-7kzw"
server_key: "d238a18af5bde7942fbd80628a4882a4"
server_key_iv: "4168fdb175d1959539b7ed9197665dee"
server_key_version: "encryptionkey@0"
I20260812 11:20:26.355865 6060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "823e2cd2444c4ecba484583c0981fb71"
format_stamp: "Formatted at 2026-08-12 11:20:26 on dist-test-slave-7kzw"
server_key: "d238a18af5bde7942fbd80628a4882a4"
server_key_iv: "4168fdb175d1959539b7ed9197665dee"
server_key_version: "encryptionkey@0"
I20260812 11:20:26.361783 6060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:20:26.366000 6083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:26.367588 6060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:26.367841 6060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "823e2cd2444c4ecba484583c0981fb71"
format_stamp: "Formatted at 2026-08-12 11:20:26 on dist-test-slave-7kzw"
server_key: "d238a18af5bde7942fbd80628a4882a4"
server_key_iv: "4168fdb175d1959539b7ed9197665dee"
server_key_version: "encryptionkey@0"
I20260812 11:20:26.368065 6060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:26.391788 6060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:26.396654 6060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:26.397019 6060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:26.419121 6060 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:33009
I20260812 11:20:26.419152 6166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:33009 every 8 connection(s)
I20260812 11:20:26.420614 6060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:26.424875 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 6060
I20260812 11:20:26.424978 6168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:26.425165 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:20:26.426091 16019 external_mini_cluster.cc:1428] Setting key f8128ba0df97cdbe0597aa48a062a88e
I20260812 11:20:26.438293 6168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71: Bootstrap starting.
Aug 12 11:20:26 dist-test-slave-7kzw krb5kdc[6040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:26.441811 6168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:26.443011 6168 log.cc:824] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:26.446218 6168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71: No bootstrap required, opened a new log
I20260812 11:20:26.450392 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:26.428377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46814 (local address 127.15.164.254:33009)
0812 11:20:26.429275 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:26.429287 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:26.429332 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:20:26.431841 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:26.431870 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:26.432277 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:26.432692 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:26.434295 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:26.435686 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:26.437044 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:26.437704 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:26.437907 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:26.442535 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:26.442547 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:26.442570 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:26.442611 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:26.445881 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:26.446775 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:26.446790 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:26.446796 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:26.446975 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:26.447395 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:26.447399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:26.447407 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:26.447961 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:26.448310 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:26.448842 (+ 532us) server_negotiation.cc:299] Negotiation successful
0812 11:20:26.449309 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":382,"threads_started":1}
I20260812 11:20:26.454707 6168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } }
I20260812 11:20:26.454952 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:20:26.455117 6168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:26.455240 6168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823e2cd2444c4ecba484583c0981fb71, State: Initialized, Role: FOLLOWER
I20260812 11:20:26.455796 6168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } }
I20260812 11:20:26.456054 6168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:26.456209 6168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:26.456393 6168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:26.459021 6168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } }
I20260812 11:20:26.459546 6168 leader_election.cc:302] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 823e2cd2444c4ecba484583c0981fb71; no voters:
I20260812 11:20:26.460150 6168 leader_election.cc:288] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:26.460302 6175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:26.461051 6175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [term 1 LEADER]: Becoming Leader. State: Replica: 823e2cd2444c4ecba484583c0981fb71, State: Running, Role: LEADER
I20260812 11:20:26.461623 6175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } }
I20260812 11:20:26.462436 6168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:26.464661 6179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "823e2cd2444c4ecba484583c0981fb71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } } }
I20260812 11:20:26.464668 6180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 823e2cd2444c4ecba484583c0981fb71. Latest consensus state: current_term: 1 leader_uuid: "823e2cd2444c4ecba484583c0981fb71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823e2cd2444c4ecba484583c0981fb71" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33009 } } }
I20260812 11:20:26.465121 6180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:26.465121 6179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:26.467253 6187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:26.471999 6187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:26.481662 6187 catalog_manager.cc:1347] Generated new cluster ID: 88abe592c77d49df8fa94d2106600666
I20260812 11:20:26.481854 6187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:26.498678 6187 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:26.499984 6187 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:26.507884 6187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 823e2cd2444c4ecba484583c0981fb71: Generated new TSK 0
I20260812 11:20:26.508817 6187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:20:26.568542 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 6060
I20260812 11:20:26.569815 6160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:26.668584 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 6060
2026-08-12T11:20:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2455 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:26 dist-test-slave-7kzw krb5kdc[6210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:26 dist-test-slave-7kzw krb5kdc[6210](info): set up 2 sockets
Aug 12 11:20:26 dist-test-slave-7kzw krb5kdc[6210](info): commencing operation
krb5kdc: starting...
W20260812 11:20:28.029928 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:20:28 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:20:28.335240 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:35067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:28.696920 6232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:28.697276 6232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:28.697456 6232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:28.705193 6232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:28.705329 6232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:28.705425 6232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:28.705526 6232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:28.705603 6232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:28.716620 6232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:35067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:28.718158 6232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:28.719627 6232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:28.732287 6240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:28.732534 6241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:28.732856 6243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:28.733726 6232 server_base.cc:1034] running on GCE node
I20260812 11:20:28.734839 6232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:28.736407 6232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:28.737648 6232 hybrid_clock.cc:648] HybridClock initialized: now 1786533628737589 us; error 57 us; skew 500 ppm
I20260812 11:20:28.738065 6232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:28 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:28.741562 6232 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:28.743472 6232 webserver.cc:460] Webserver started at http://127.15.164.254:38839/ using document root <none> and password file <none>
I20260812 11:20:28.744258 6232 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:28.744417 6232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:28.744778 6232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:28.748049 6232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "aac34eba548d49f8b37b2ce599e399bf"
format_stamp: "Formatted at 2026-08-12 11:20:28 on dist-test-slave-7kzw"
server_key: "cd5d1aff9ff845de0b4df68890d1e755"
server_key_iv: "b74240c3767b23adf20f4080680f4d7d"
server_key_version: "encryptionkey@0"
I20260812 11:20:28.748894 6232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "aac34eba548d49f8b37b2ce599e399bf"
format_stamp: "Formatted at 2026-08-12 11:20:28 on dist-test-slave-7kzw"
server_key: "cd5d1aff9ff845de0b4df68890d1e755"
server_key_iv: "b74240c3767b23adf20f4080680f4d7d"
server_key_version: "encryptionkey@0"
I20260812 11:20:28.755348 6232 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:20:28.759387 6253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:28.760823 6232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:28.761036 6232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "aac34eba548d49f8b37b2ce599e399bf"
format_stamp: "Formatted at 2026-08-12 11:20:28 on dist-test-slave-7kzw"
server_key: "cd5d1aff9ff845de0b4df68890d1e755"
server_key_iv: "b74240c3767b23adf20f4080680f4d7d"
server_key_version: "encryptionkey@0"
I20260812 11:20:28.761274 6232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:28.780910 6232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:28.785768 6232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:28.786116 6232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:28.807261 6232 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:35067
I20260812 11:20:28.807343 6333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:35067 every 8 connection(s)
I20260812 11:20:28.809056 6232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:28.813344 6334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:28.815191 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 6232
I20260812 11:20:28.815446 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:20:28.816200 16019 external_mini_cluster.cc:1428] Setting key e77730d5b5d26ff42167dca2bafbcd7f
I20260812 11:20:28.829195 6334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap starting.
Aug 12 11:20:28 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:28.832567 6334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:28.834506 6334 log.cc:824] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:28.837932 6334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: No bootstrap required, opened a new log
I20260812 11:20:28.842211 6339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:28.818509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.15.164.254:35067)
0812 11:20:28.819458 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:28.819476 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:28.819544 (+ 68us) server_negotiation.cc:407] Connection header received
0812 11:20:28.821315 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:28.821349 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:28.821922 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:28.822379 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:28.823929 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:28.826157 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:28.827658 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:28.828692 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:28.828908 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:28.833594 (+ 4686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:28.833607 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:28.833627 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:28.833771 (+ 144us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:28.837550 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:28.838455 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:28.838507 (+ 52us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:28.838516 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:28.838703 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:28.839187 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:28.839191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:28.839193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:28.839788 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:28.840187 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:28.840661 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:20:28.841111 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":379,"threads_started":1}
I20260812 11:20:28.847255 6334 raft_consensus.cc:348] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:28.847836 6334 raft_consensus.cc:374] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:28.847970 6334 raft_consensus.cc:729] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Initialized, Role: FOLLOWER
I20260812 11:20:28.848695 6334 consensus_queue.cc:260] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:28.848966 6334 raft_consensus.cc:388] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:28.849126 6334 raft_consensus.cc:482] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:28.849320 6334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:28.851758 6334 raft_consensus.cc:504] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:28.852324 6334 leader_election.cc:302] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aac34eba548d49f8b37b2ce599e399bf; no voters:
I20260812 11:20:28.852980 6334 leader_election.cc:288] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:28.853168 6341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:28.854007 6341 raft_consensus.cc:686] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 LEADER]: Becoming Leader. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Running, Role: LEADER
I20260812 11:20:28.854758 6341 consensus_queue.cc:237] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:28.855365 6334 sys_catalog.cc:564] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:28.858613 6342 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:28.859018 6342 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:28.859503 6343 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader aac34eba548d49f8b37b2ce599e399bf. Latest consensus state: current_term: 1 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:28.859848 6343 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:28.860244 6350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:28.867611 6350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:28.878247 6350 catalog_manager.cc:1347] Generated new cluster ID: 8956e2021b8e4c51be9b127125974e25
I20260812 11:20:28.878458 6350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:28.895601 6350 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:28.897119 6350 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:28.904296 6350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Generated new TSK 0
I20260812 11:20:28.905270 6350 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:20:28.983915 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:29.343154 6376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:29.343595 6376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:29.343765 6376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:29.351157 6376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:29.351310 6376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:29.351486 6376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:29.361763 6376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:29.363196 6376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:29.364706 6376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:29.379043 6384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:29.379159 6383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:29.379277 6386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:29.379907 6376 server_base.cc:1034] running on GCE node
I20260812 11:20:29.380616 6376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:29.381618 6376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:29.382910 6376 hybrid_clock.cc:648] HybridClock initialized: now 1786533629382854 us; error 52 us; skew 500 ppm
I20260812 11:20:29.383288 6376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:29 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533629, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:29.386911 6376 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:29.388537 6376 webserver.cc:460] Webserver started at http://127.15.164.193:41099/ using document root <none> and password file <none>
I20260812 11:20:29.389384 6376 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:29.389540 6376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:29.389892 6376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:29.393118 6376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "45c70205b9db38ea1bc3d4da7debccd9"
server_key_iv: "cac7fac44d663902cf11f7d0e5e90a8a"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.393976 6376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "45c70205b9db38ea1bc3d4da7debccd9"
server_key_iv: "cac7fac44d663902cf11f7d0e5e90a8a"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.399708 6376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260812 11:20:29.403615 6393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:29.405300 6376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:20:29.405517 6376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "45c70205b9db38ea1bc3d4da7debccd9"
server_key_iv: "cac7fac44d663902cf11f7d0e5e90a8a"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.405769 6376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:29.423710 6376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:29.428905 6376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:29.429280 6376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:29.430433 6376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:29.432272 6376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:29.432488 6376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:29.432703 6376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:29.432794 6376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:29.471457 6376 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:34719
I20260812 11:20:29.471504 6559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:34719 every 8 connection(s)
I20260812 11:20:29.472843 6376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:29.476536 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 6376
I20260812 11:20:29.476817 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:20:29.477643 16019 external_mini_cluster.cc:1428] Setting key 6fed282f93f112c031e9fef057c1e6f3
Aug 12 11:20:29 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533629, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:29.495538 6564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:29.475657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:34851 (local address 127.15.164.254:35067)
0812 11:20:29.476146 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:29.476151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:29.477427 (+ 1276us) server_negotiation.cc:407] Connection header received
0812 11:20:29.479495 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:29.479502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:29.479595 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:29.479726 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:29.481226 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:29.481939 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:29.483640 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:29.484051 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:29.484196 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:29.488923 (+ 4727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:29.488932 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:29.488940 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:29.488992 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:29.492094 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:29.493091 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:29.493094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:29.493097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:29.493221 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:29.493726 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:29.493729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:29.493731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:29.494003 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:29.494115 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:29.495088 (+ 973us) server_negotiation.cc:299] Negotiation successful
0812 11:20:29.495273 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":272,"threads_started":1}
I20260812 11:20:29.497128 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:29.476364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:34851)
0812 11:20:29.477260 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:29.477299 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:29.479222 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:29.479965 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:29.479973 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:29.480487 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:29.481050 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:29.481066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:29.482125 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:29.482130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:29.483463 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:29.483476 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:29.484306 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:29.484315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:29.484544 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:29.485522 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:29.485570 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:29.488645 (+ 3075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:29.492253 (+ 3608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:29.492267 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:29.492287 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:29.492960 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:29.493340 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:29.493347 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:29.493350 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:29.493610 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:29.494153 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:29.494163 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:29.494670 (+ 507us) client_negotiation.cc:769] Sending connection context
0812 11:20:29.494999 (+ 329us) client_negotiation.cc:240] Negotiation successful
0812 11:20:29.495625 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":353,"threads_started":1}
I20260812 11:20:29.498855 6560 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:29.499184 6560 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:29.499984 6560 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:29.502218 6281 ts_manager.cc:194] Registered new tserver with Master: 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719)
I20260812 11:20:29.503805 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:34851
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:20:29.541860 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:29.891409 6570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:29.891760 6570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:29.891944 6570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:29.899312 6570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:29.899479 6570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:29.899660 6570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:29.910214 6570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:29.911656 6570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:29.913111 6570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:29.927050 6579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:29.927109 6582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:29.927022 6577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:29.927892 6570 server_base.cc:1034] running on GCE node
I20260812 11:20:29.928507 6570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:29.929524 6570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:29.930774 6570 hybrid_clock.cc:648] HybridClock initialized: now 1786533629930702 us; error 58 us; skew 500 ppm
I20260812 11:20:29.931134 6570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:29 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533629, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:29.934571 6570 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:29.936172 6570 webserver.cc:460] Webserver started at http://127.15.164.194:44195/ using document root <none> and password file <none>
I20260812 11:20:29.936915 6570 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:29.937069 6570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:29.937427 6570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:29.940532 6570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "d5c7988dc722a62b3d1f95e53e13ed94"
server_key_iv: "1809f7c0a257befa4671b436aaad6e27"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.941359 6570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "d5c7988dc722a62b3d1f95e53e13ed94"
server_key_iv: "1809f7c0a257befa4671b436aaad6e27"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.946870 6570 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:20:29.950740 6590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:29.952517 6570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:29.952764 6570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "d5c7988dc722a62b3d1f95e53e13ed94"
server_key_iv: "1809f7c0a257befa4671b436aaad6e27"
server_key_version: "encryptionkey@0"
I20260812 11:20:29.953020 6570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:29.974525 6570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:29.979339 6570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:29.979678 6570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:29.980822 6570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:29.982331 6570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:29.982443 6570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:29.982633 6570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:29.982712 6570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:30.019074 6570 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46661
I20260812 11:20:30.019110 6771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46661 every 8 connection(s)
I20260812 11:20:30.020466 6570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:30.029958 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 6570
I20260812 11:20:30.030296 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:20:30.030846 16019 external_mini_cluster.cc:1428] Setting key ffedb2a7ed088c011735bfcf1439c7be
Aug 12 11:20:30 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533629, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:30.043390 6775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.023210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:33989 (local address 127.15.164.254:35067)
0812 11:20:30.023705 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.023710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.024970 (+ 1260us) server_negotiation.cc:407] Connection header received
0812 11:20:30.026920 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.026926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.027025 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.027158 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:30.028804 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.029649 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.031955 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.032533 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.032715 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.036838 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:30.036845 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:30.036848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:30.036885 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:30.039918 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.040851 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.040856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.040860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.041003 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.041482 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.041486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.041488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.041779 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:30.041945 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.042753 (+ 808us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.042984 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":377,"thread_start_us":245,"threads_started":1}
I20260812 11:20:30.044528 6777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.023793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:33989)
0812 11:20:30.024785 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.024834 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.026632 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.027439 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.027447 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.027986 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:30.028603 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.028622 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.030014 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.030019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.031781 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.031797 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.032867 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.032875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.033216 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.034056 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:30.034087 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:30.036461 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:30.040182 (+ 3721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:30.040193 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:30.040214 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:30.040702 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:30.041136 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:30.041141 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:30.041145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:30.041347 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:30.041920 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:30.041929 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:30.042308 (+ 379us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.042663 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.043253 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":278,"threads_started":1}
I20260812 11:20:30.046324 6772 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:30.046767 6772 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:30.047695 6772 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:30.049445 6281 ts_manager.cc:194] Registered new tserver with Master: 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661)
I20260812 11:20:30.050361 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:33989
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:20:30.098450 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:30.460158 6780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:30.460450 6780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:30.460642 6780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:30.468624 6780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:30.468755 6780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:30.468938 6780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:30.482447 6780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:30.483877 6780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:30.485292 6780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:30.500921 6786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:30.500823 6790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:30.501295 6787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:30.502032 6780 server_base.cc:1034] running on GCE node
I20260812 11:20:30.502852 6780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:30.503988 6780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:30.505228 6780 hybrid_clock.cc:648] HybridClock initialized: now 1786533630505164 us; error 60 us; skew 500 ppm
I20260812 11:20:30.505582 6780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:20:30.506946 6560 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
Aug 12 11:20:30 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533630, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:30.509485 6780 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:30.511430 6780 webserver.cc:460] Webserver started at http://127.15.164.195:33969/ using document root <none> and password file <none>
I20260812 11:20:30.512192 6780 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:30.512343 6780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:30.512684 6780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:30.515818 6780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "61fbb71f25b34c739f86637db5e3e083"
format_stamp: "Formatted at 2026-08-12 11:20:30 on dist-test-slave-7kzw"
server_key: "f1f22b02fd05f30f27a5657607f55805"
server_key_iv: "e46909ed07a030503f39d964dc134b6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:30.516647 6780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "61fbb71f25b34c739f86637db5e3e083"
format_stamp: "Formatted at 2026-08-12 11:20:30 on dist-test-slave-7kzw"
server_key: "f1f22b02fd05f30f27a5657607f55805"
server_key_iv: "e46909ed07a030503f39d964dc134b6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:30.522204 6780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:20:30.525971 6804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:30.527552 6780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:30.527738 6780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "61fbb71f25b34c739f86637db5e3e083"
format_stamp: "Formatted at 2026-08-12 11:20:30 on dist-test-slave-7kzw"
server_key: "f1f22b02fd05f30f27a5657607f55805"
server_key_iv: "e46909ed07a030503f39d964dc134b6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:30.527932 6780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:30.557720 6780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:30.562673 6780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:30.562983 6780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:30.564087 6780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:30.565701 6780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:30.565805 6780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:30.565959 6780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:30.566059 6780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:30.603693 6780 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44763
I20260812 11:20:30.603734 6990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44763 every 8 connection(s)
I20260812 11:20:30.605062 6780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:30.609052 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 6780
I20260812 11:20:30.609338 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:20:30.609910 16019 external_mini_cluster.cc:1428] Setting key dbd80128d72fd9250d8f4f5c2ddf722f
Aug 12 11:20:30 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533630, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:30.633350 6994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.608015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:60421 (local address 127.15.164.254:35067)
0812 11:20:30.608501 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.608505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.615193 (+ 6688us) server_negotiation.cc:407] Connection header received
0812 11:20:30.617075 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.617080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.617181 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.617303 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:30.618998 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.619793 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.621381 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.621783 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.621919 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.626548 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:30.626553 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:30.626557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:30.626592 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:30.629475 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.630597 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.630601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.630603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.630737 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.631349 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.631352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.631354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.631642 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:30.631761 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.632777 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.633057 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":260,"threads_started":1}
I20260812 11:20:30.635099 6996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.608765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:60421)
0812 11:20:30.615019 (+ 6254us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.615074 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.616800 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.617588 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.617597 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.618140 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:30.618821 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.618840 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.619960 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.619965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.621224 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.621236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.622034 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.622041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.622276 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.623085 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:30.623109 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:30.626272 (+ 3163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:30.629642 (+ 3370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:30.629655 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:30.629681 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:30.630423 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:30.630860 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:30.630867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:30.630873 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:30.631172 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:30.631790 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:30.631802 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:30.632337 (+ 535us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.632689 (+ 352us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.633372 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5981,"thread_start_us":5764,"threads_started":1}
I20260812 11:20:30.636871 6992 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:30.637207 6992 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:30.638243 6992 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:30.639961 6281 ts_manager.cc:194] Registered new tserver with Master: 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763)
I20260812 11:20:30.640851 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:60421
I20260812 11:20:30.651948 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:30.676012 6994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.659433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.15.164.254:35067)
0812 11:20:30.659705 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.659715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.660307 (+ 592us) server_negotiation.cc:407] Connection header received
0812 11:20:30.660576 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.660581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.660667 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.660809 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:30.663268 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.664122 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.666674 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.667097 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.667211 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.670613 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:30.670618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:30.670621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:30.670657 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:30.673344 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.674058 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.674062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.674064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.674201 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:30.674660 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:30.674664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:30.674667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:30.675028 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:30.675236 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.675550 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.675779 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:20:30.680493 6281 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:20:30.687672 6281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:20:30.713583 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.702155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:46661 (local address 127.0.0.1:40444)
0812 11:20:30.703019 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.703050 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.703179 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.705679 (+ 2500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.705684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.705713 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:30.706165 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.706177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.707936 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.707942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.710345 (+ 2403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.710369 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.712376 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.712383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.712603 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.712671 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.712821 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.713055 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":2,"thread_start_us":557,"threads_started":1}
I20260812 11:20:30.713729 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.703736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:34719 (local address 127.0.0.1:45536)
0812 11:20:30.704822 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.704840 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.704952 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.706159 (+ 1207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.706164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.706190 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:30.706644 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.706654 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.708838 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.708845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.710544 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.710560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.712712 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.712720 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.712894 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.712929 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.713033 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.713190 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"mutex_wait_us":26,"thread_start_us":805,"threads_started":1}
I20260812 11:20:30.714048 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.704147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45536 (local address 127.15.164.193:34719)
0812 11:20:30.705563 (+ 1416us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.705573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.705602 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:20:30.705698 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.705706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.705930 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.706116 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:30.706831 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.708663 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.710692 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.712062 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.712293 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.712518 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.713448 (+ 930us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.713661 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1231,"thread_start_us":1075,"threads_started":1}
I20260812 11:20:30.714727 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.700891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44763 (local address 127.0.0.1:37284)
0812 11:20:30.701677 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.701719 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.701929 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.703722 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.703733 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.703788 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:30.704304 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.704318 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.707061 (+ 2743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.707067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.710958 (+ 3891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.710974 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.713332 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.713342 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.713528 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.713579 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.714084 (+ 505us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.714322 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":4,"thread_start_us":398,"threads_started":1}
I20260812 11:20:30.714910 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.700982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.15.164.195:44763)
0812 11:20:30.702763 (+ 1781us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.702777 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.702821 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:20:30.702980 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.702991 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.703325 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.703542 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:30.705210 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.706902 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.711228 (+ 4326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.712734 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.712984 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.713149 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.714179 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.714400 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1538,"thread_start_us":1338,"threads_started":1}
I20260812 11:20:30.715139 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.702324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40444 (local address 127.15.164.194:46661)
0812 11:20:30.704985 (+ 2661us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.704999 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.705038 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:20:30.705167 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.705179 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.705453 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.705697 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:30.706393 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.707750 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.710564 (+ 2814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.712144 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.714260 (+ 2116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.714487 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.714562 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.714753 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1233,"thread_start_us":1091,"threads_started":1}
I20260812 11:20:30.718719 6887 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfbab5a901d468faa5200edba5c7234 (DEFAULT_TABLE table=test-table [id=33e643d45ddd43ef95addc97e80eb8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:30.718688 6667 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfbab5a901d468faa5200edba5c7234 (DEFAULT_TABLE table=test-table [id=33e643d45ddd43ef95addc97e80eb8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:30.718688 6462 tablet_service.cc:1467] Processing CreateTablet for tablet 6cfbab5a901d468faa5200edba5c7234 (DEFAULT_TABLE table=test-table [id=33e643d45ddd43ef95addc97e80eb8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:30.720211 6887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfbab5a901d468faa5200edba5c7234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:30.720245 6667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfbab5a901d468faa5200edba5c7234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:30.720245 6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cfbab5a901d468faa5200edba5c7234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:30.733958 7017 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Bootstrap starting.
I20260812 11:20:30.736227 7024 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Bootstrap starting.
I20260812 11:20:30.737125 7019 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Bootstrap starting.
I20260812 11:20:30.739136 7017 tablet_bootstrap.cc:654] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:30.740211 7017 log.cc:824] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:30.741003 7019 tablet_bootstrap.cc:654] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:30.742257 7024 tablet_bootstrap.cc:654] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:30.742394 7019 log.cc:824] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:30.743296 7017 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: No bootstrap required, opened a new log
I20260812 11:20:30.743608 7017 ts_tablet_manager.cc:1397] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260812 11:20:30.743651 7024 log.cc:824] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:30.745759 7019 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: No bootstrap required, opened a new log
I20260812 11:20:30.746152 7019 ts_tablet_manager.cc:1397] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 11:20:30.747117 7024 tablet_bootstrap.cc:492] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: No bootstrap required, opened a new log
I20260812 11:20:30.747421 7024 ts_tablet_manager.cc:1397] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260812 11:20:30.751816 7017 raft_consensus.cc:348] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.752213 7017 raft_consensus.cc:374] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:30.752384 7017 raft_consensus.cc:729] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbb71f25b34c739f86637db5e3e083, State: Initialized, Role: FOLLOWER
I20260812 11:20:30.753073 7017 consensus_queue.cc:260] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.754318 6992 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
I20260812 11:20:30.755100 7017 ts_tablet_manager.cc:1428] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
I20260812 11:20:30.758785 7019 raft_consensus.cc:348] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.759305 7019 raft_consensus.cc:374] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:30.759424 7019 raft_consensus.cc:729] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7a7e8f98784e04bc61cfac489cec5e, State: Initialized, Role: FOLLOWER
I20260812 11:20:30.759863 7024 raft_consensus.cc:348] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.760170 7019 consensus_queue.cc:260] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.760419 7024 raft_consensus.cc:374] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:30.760571 7024 raft_consensus.cc:729] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e91f0f6d9e340c9a9615208bf8306ea, State: Initialized, Role: FOLLOWER
I20260812 11:20:30.761493 7024 consensus_queue.cc:260] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.761713 6772 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
I20260812 11:20:30.762424 7019 ts_tablet_manager.cc:1428] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260812 11:20:30.763434 7024 ts_tablet_manager.cc:1428] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Time spent starting tablet: real 0.016s user 0.013s sys 0.002s
W20260812 11:20:30.772583 6774 tablet.cc:2369] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:20:30.857211 6993 tablet.cc:2369] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:30.937301 7031 raft_consensus.cc:482] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:30.937686 7031 raft_consensus.cc:504] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.939700 7031 leader_election.cc:288] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763), 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661)
I20260812 11:20:30.948066 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.940312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:45961 (local address 127.15.164.195:44763)
0812 11:20:30.940628 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.940635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.941457 (+ 822us) server_negotiation.cc:407] Connection header received
0812 11:20:30.941617 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.941623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.941703 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.941803 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:30.942736 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.943898 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.946158 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.947026 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.947235 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.947330 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.947649 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.947783 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:20:30.948251 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.940308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41689 (local address 127.15.164.194:46661)
0812 11:20:30.940752 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:30.940773 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:30.941214 (+ 441us) server_negotiation.cc:407] Connection header received
0812 11:20:30.941540 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:30.941549 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:30.941685 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:30.941804 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:30.942763 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.943898 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.946217 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.947159 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.947386 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.947476 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:30.947810 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 11:20:30.947954 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270}
I20260812 11:20:30.948324 7032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.940065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44763 (local address 127.15.164.193:45961)
0812 11:20:30.941327 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.941348 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.941480 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.941864 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.941870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.941971 (+ 101us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:30.942561 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.942571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.944119 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.944127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.945982 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.945996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.947247 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.947254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.947474 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.947501 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.947617 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.947767 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":87,"spinlock_wait_cycles":27904,"thread_start_us":465,"threads_started":1}
I20260812 11:20:30.948423 7035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:30.940065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:46661 (local address 127.15.164.193:41689)
0812 11:20:30.941035 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:30.941064 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:30.941275 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:30.941864 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:30.941870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:30.941901 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:30.942529 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.942551 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.944060 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.944067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.946027 (+ 1960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:30.946042 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:30.947437 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:30.947444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:30.947612 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:30.947639 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:20:30.947756 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:20:30.947907 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":5,"thread_start_us":827,"threads_started":1}
I20260812 11:20:30.949767 6698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfbab5a901d468faa5200edba5c7234" candidate_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" is_pre_election: true
I20260812 11:20:30.949767 6923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfbab5a901d468faa5200edba5c7234" candidate_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbb71f25b34c739f86637db5e3e083" is_pre_election: true
I20260812 11:20:30.950403 6923 raft_consensus.cc:2454] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e91f0f6d9e340c9a9615208bf8306ea in term 0.
I20260812 11:20:30.950404 6698 raft_consensus.cc:2454] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e91f0f6d9e340c9a9615208bf8306ea in term 0.
I20260812 11:20:30.951289 6396 leader_election.cc:302] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2e91f0f6d9e340c9a9615208bf8306ea, 5f7a7e8f98784e04bc61cfac489cec5e, 61fbb71f25b34c739f86637db5e3e083; no voters:
I20260812 11:20:30.951848 7031 raft_consensus.cc:2781] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:30.952045 7031 raft_consensus.cc:482] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:30.952201 7031 raft_consensus.cc:3037] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:30.954814 7031 raft_consensus.cc:504] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.955679 7031 leader_election.cc:288] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [CANDIDATE]: Term 1 election: Requested vote from peers 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763), 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661)
I20260812 11:20:30.956357 6698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfbab5a901d468faa5200edba5c7234" candidate_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
I20260812 11:20:30.956357 6923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cfbab5a901d468faa5200edba5c7234" candidate_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbb71f25b34c739f86637db5e3e083"
I20260812 11:20:30.956614 6923 raft_consensus.cc:3037] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:30.956614 6698 raft_consensus.cc:3037] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:30.960423 6923 raft_consensus.cc:2454] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e91f0f6d9e340c9a9615208bf8306ea in term 1.
I20260812 11:20:30.960421 6698 raft_consensus.cc:2454] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e91f0f6d9e340c9a9615208bf8306ea in term 1.
I20260812 11:20:30.961077 6396 leader_election.cc:302] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2e91f0f6d9e340c9a9615208bf8306ea, 5f7a7e8f98784e04bc61cfac489cec5e, 61fbb71f25b34c739f86637db5e3e083; no voters:
I20260812 11:20:30.961596 7031 raft_consensus.cc:2781] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:30.962102 7031 raft_consensus.cc:686] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 LEADER]: Becoming Leader. State: Replica: 2e91f0f6d9e340c9a9615208bf8306ea, State: Running, Role: LEADER
I20260812 11:20:30.962746 7031 consensus_queue.cc:237] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } }
I20260812 11:20:30.967897 6281 catalog_manager.cc:5495] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193). New cstate: current_term: 1 leader_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } health_report { overall_health: HEALTHY } } }
W20260812 11:20:30.975587 6562 tablet.cc:2369] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:31.017364 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:31.011047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.15.164.193:34719)
0812 11:20:31.011275 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:31.011281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:31.011322 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:20:31.011637 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:31.011642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:31.011746 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:31.011894 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:20:31.012371 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.013254 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.014908 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.015360 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.015471 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:31.016054 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:20:31.016641 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:20:31.016804 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:31.016926 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 11:20:31.017007 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:20:31.026883 6923 raft_consensus.cc:1261] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Refusing update from remote peer 2e91f0f6d9e340c9a9615208bf8306ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:31.026935 6698 raft_consensus.cc:1261] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Refusing update from remote peer 2e91f0f6d9e340c9a9615208bf8306ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:31.028079 7036 consensus_queue.cc:1035] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:31.028517 7031 consensus_queue.cc:1035] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:31.060961 6279 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:31.061333 6279 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:31.065810 6279 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Sending DeleteTablet for 3 replicas of tablet 6cfbab5a901d468faa5200edba5c7234
I20260812 11:20:31.067173 6887 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfbab5a901d468faa5200edba5c7234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:31 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:37284
I20260812 11:20:31.067368 6667 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfbab5a901d468faa5200edba5c7234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:31 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:40444
I20260812 11:20:31.067605 6462 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cfbab5a901d468faa5200edba5c7234 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:31 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:45536
I20260812 11:20:31.067831 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 6376
I20260812 11:20:31.079843 7071 tablet_replica.cc:330] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: stopping tablet replica
I20260812 11:20:31.080422 7072 tablet_replica.cc:330] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: stopping tablet replica
I20260812 11:20:31.080391 7071 raft_consensus.cc:2229] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:31.080832 7072 raft_consensus.cc:2229] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:20:31.080986 7071 raft_consensus.cc:2258] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:31.081722 7072 raft_consensus.cc:2258] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:31.081856 7068 tablet_replica.cc:330] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: stopping tablet replica
I20260812 11:20:31.082249 7068 raft_consensus.cc:2229] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:31.082813 7068 raft_consensus.cc:2258] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:31.084996 7068 ts_tablet_manager.cc:1905] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:31.089156 7072 ts_tablet_manager.cc:1905] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:31.092319 7068 ts_tablet_manager.cc:1918] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:31.092479 7068 log.cc:1196] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/6cfbab5a901d468faa5200edba5c7234
Aug 12 11:20:31 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:20:31.093022 7068 ts_tablet_manager.cc:1939] T 6cfbab5a901d468faa5200edba5c7234 P 61fbb71f25b34c739f86637db5e3e083: Deleting consensus metadata
I20260812 11:20:31.095990 7071 ts_tablet_manager.cc:1905] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:31.098016 7072 ts_tablet_manager.cc:1918] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:31.099597 7072 log.cc:1196] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/6cfbab5a901d468faa5200edba5c7234
I20260812 11:20:31.100244 7072 ts_tablet_manager.cc:1939] T 6cfbab5a901d468faa5200edba5c7234 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting consensus metadata
I20260812 11:20:31.102226 6256 catalog_manager.cc:4841] TS 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719): tablet 6cfbab5a901d468faa5200edba5c7234 (table test-table [id=33e643d45ddd43ef95addc97e80eb8c7]) successfully deleted
I20260812 11:20:31.103035 7071 ts_tablet_manager.cc:1918] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:31.103215 7071 log.cc:1196] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/6cfbab5a901d468faa5200edba5c7234
I20260812 11:20:31.103478 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:31.069364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45562 (local address 127.15.164.193:34719)
0812 11:20:31.069608 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:31.069618 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:31.079430 (+ 9812us) server_negotiation.cc:407] Connection header received
0812 11:20:31.079943 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:31.079948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:31.080045 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:31.080182 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:31.084055 (+ 3873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.085283 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.087336 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.088092 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.088236 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:31.094304 (+ 6068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:31.094322 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:31.094341 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:31.094385 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:31.099244 (+ 4859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.100392 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.100402 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.100405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.100571 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.101054 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.101059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.101063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.101584 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:31.101904 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:31.102603 (+ 699us) server_negotiation.cc:299] Negotiation successful
0812 11:20:31.102852 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:20:31.103426 6255 catalog_manager.cc:4841] TS 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763): tablet 6cfbab5a901d468faa5200edba5c7234 (table test-table [id=33e643d45ddd43ef95addc97e80eb8c7]) successfully deleted
I20260812 11:20:31.103777 7071 ts_tablet_manager.cc:1939] T 6cfbab5a901d468faa5200edba5c7234 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting consensus metadata
I20260812 11:20:31.105293 6554 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:31.105580 6256 catalog_manager.cc:4841] TS 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661): tablet 6cfbab5a901d468faa5200edba5c7234 (table test-table [id=33e643d45ddd43ef95addc97e80eb8c7]) successfully deleted
I20260812 11:20:31.206007 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 6376
I20260812 11:20:31.238994 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 6570
Aug 12 11:20:31 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:20:31.266310 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:31.239937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40446 (local address 127.15.164.194:46661)
0812 11:20:31.240175 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:31.240182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:31.240204 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:20:31.240393 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:31.240403 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:31.240475 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:31.240607 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:31.242784 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.243717 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.245455 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.245890 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.245989 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:31.259653 (+ 13664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:31.259673 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:31.259699 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:31.259749 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:31.263370 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.264103 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.264111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.264113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.264273 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.264611 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.264614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.264617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.265097 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:31.265378 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:31.265660 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 11:20:31.265893 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:20:31.267207 6763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:31.362984 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 6570
I20260812 11:20:31.389031 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 6780
Aug 12 11:20:31 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:20:31.406296 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:31.390058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.15.164.195:44763)
0812 11:20:31.390286 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:31.390294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:31.390317 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:20:31.390389 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:31.390393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:31.390457 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:31.390620 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:31.391905 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.392656 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.393988 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:31.394766 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:31.394912 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:31.400209 (+ 5297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:31.400227 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:31.400245 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:31.400293 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:31.403282 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.404054 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.404062 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.404064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.404231 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:31.404655 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:31.404660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:31.404663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:31.405046 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:31.405356 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:31.405694 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 11:20:31.405918 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 11:20:31.407096 6984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:31.498706 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 6780
I20260812 11:20:31.527417 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 6232
I20260812 11:20:31.528693 6326 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:31.641475 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 6232
I20260812 11:20:31.677364 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--webserver_interface=127.15.164.254
--webserver_port=38839
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:35067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:32.041554 7083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:32.041953 7083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:32.042143 7083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:32.049642 7083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:32.049803 7083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:32.049924 7083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:32.050037 7083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:32.050112 7083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:32.060382 7083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:35067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=38839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:32.061856 7083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:32.063261 7083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:32.089359 7094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:32.089421 7091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:32.089614 7089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:32.090752 7083 server_base.cc:1034] running on GCE node
I20260812 11:20:32.091830 7083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:32.093669 7083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:32.094907 7083 hybrid_clock.cc:648] HybridClock initialized: now 1786533632094829 us; error 63 us; skew 500 ppm
I20260812 11:20:32.095335 7083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:32 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533632, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:32.099238 7083 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:32.101055 7083 webserver.cc:460] Webserver started at http://127.15.164.254:38839/ using document root <none> and password file <none>
I20260812 11:20:32.101841 7083 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:32.101974 7083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:32.108441 7083 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:20:32.112040 7102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:32.113703 7083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:20:32.113958 7083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "aac34eba548d49f8b37b2ce599e399bf"
format_stamp: "Formatted at 2026-08-12 11:20:28 on dist-test-slave-7kzw"
server_key: "cd5d1aff9ff845de0b4df68890d1e755"
server_key_iv: "b74240c3767b23adf20f4080680f4d7d"
server_key_version: "encryptionkey@0"
I20260812 11:20:32.115376 7083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:32.134859 7083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:32.140058 7083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:32.140429 7083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:32.163120 7083 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:35067
I20260812 11:20:32.163139 7172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:35067 every 8 connection(s)
I20260812 11:20:32.164969 7083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:32.167024 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 7083
I20260812 11:20:32.167991 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:34719
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=41099
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:32.172770 7173 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:20:32.176388 7173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap starting.
I20260812 11:20:32.204919 7173 log.cc:824] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:32.221977 7173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:20:32.222707 7173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap complete.
I20260812 11:20:32.236400 7173 raft_consensus.cc:348] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:32.237345 7173 raft_consensus.cc:729] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Initialized, Role: FOLLOWER
I20260812 11:20:32.238050 7173 consensus_queue.cc:260] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:32.238335 7173 raft_consensus.cc:388] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:32.238505 7173 raft_consensus.cc:482] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:32.238723 7173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:20:32.242709 7173 raft_consensus.cc:504] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:32.243319 7173 leader_election.cc:302] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aac34eba548d49f8b37b2ce599e399bf; no voters:
I20260812 11:20:32.243954 7173 leader_election.cc:288] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:20:32.244210 7179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:20:32.247555 7173 sys_catalog.cc:564] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:32.248392 7179 raft_consensus.cc:686] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 LEADER]: Becoming Leader. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Running, Role: LEADER
I20260812 11:20:32.249048 7179 consensus_queue.cc:237] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:32.254231 7182 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader aac34eba548d49f8b37b2ce599e399bf. Latest consensus state: current_term: 2 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:32.255159 7182 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:32.254731 7180 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:32.255865 7180 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:32.263913 7197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:32.274004 7197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:32.276219 7197 catalog_manager.cc:1259] Loaded cluster ID: 8956e2021b8e4c51be9b127125974e25
I20260812 11:20:32.276437 7197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:32.280905 7197 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 11:20:32.296777 7197 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 11:20:32.305089 7197 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:32.306869 7197 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Loaded TSK: 0
I20260812 11:20:32.308157 7197 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:20:32.581343 7177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:32.581775 7177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:32.581943 7177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:32.589363 7177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:32.589534 7177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:32.589709 7177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:32.600162 7177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:34719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=41099
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:32.601840 7177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:32.603430 7177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:32.619244 7225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:32.619221 7228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:32.620158 7232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:32.620728 7177 server_base.cc:1034] running on GCE node
I20260812 11:20:32.621534 7177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:32.622697 7177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:32.623961 7177 hybrid_clock.cc:648] HybridClock initialized: now 1786533632623887 us; error 54 us; skew 500 ppm
I20260812 11:20:32.624327 7177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:32 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533632, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:32.627653 7177 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:32.629256 7177 webserver.cc:460] Webserver started at http://127.15.164.193:41099/ using document root <none> and password file <none>
I20260812 11:20:32.629962 7177 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:32.630110 7177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:32.635759 7177 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:20:32.638736 7249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:32.640199 7177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:20:32.640395 7177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "45c70205b9db38ea1bc3d4da7debccd9"
server_key_iv: "cac7fac44d663902cf11f7d0e5e90a8a"
server_key_version: "encryptionkey@0"
I20260812 11:20:32.641363 7177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:32.690035 7177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:32.694957 7177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:32.695261 7177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:32.696327 7177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:32.697907 7177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:32.698014 7177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:32.698166 7177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:32.698271 7177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:32.732215 7177 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:34719
I20260812 11:20:32.732316 7424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:34719 every 8 connection(s)
I20260812 11:20:32.733832 7177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:32.734799 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 7177
I20260812 11:20:32.735641 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:46661
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=44195
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:20:32 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533632, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:32.762848 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:32.737362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:37887 (local address 127.15.164.254:35067)
0812 11:20:32.738167 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:32.738186 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:32.739316 (+ 1130us) server_negotiation.cc:407] Connection header received
0812 11:20:32.741496 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:32.741529 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:32.741984 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:32.742427 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:32.743950 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:32.746086 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:32.748740 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:32.749470 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:32.749614 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:32.754037 (+ 4423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:32.754046 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:32.754061 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:32.754103 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:32.757885 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:32.758737 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:32.758747 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:32.758761 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:32.758999 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:32.759441 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:32.759446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:32.759450 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:32.759953 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:32.760163 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:32.761071 (+ 908us) server_negotiation.cc:299] Negotiation successful
0812 11:20:32.761463 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":322,"threads_started":1}
I20260812 11:20:32.762848 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:32.737485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:37887)
0812 11:20:32.739088 (+ 1603us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:32.739151 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:32.740885 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:32.742595 (+ 1710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:32.742603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:32.743128 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:32.743661 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:32.743710 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:32.746287 (+ 2577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:32.746295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:32.748538 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:32.748557 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:32.749721 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:32.749730 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:32.750072 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:32.750912 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:32.750947 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:32.753737 (+ 2790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:32.758042 (+ 4305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:32.758054 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:32.758072 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:32.758582 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:32.759107 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:32.759112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:32.759116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:32.759314 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:32.760103 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:32.760112 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:32.760507 (+ 395us) client_negotiation.cc:769] Sending connection context
0812 11:20:32.760853 (+ 346us) client_negotiation.cc:240] Negotiation successful
0812 11:20:32.761441 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1319,"thread_start_us":1079,"threads_started":1}
I20260812 11:20:32.766381 7428 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:32.766795 7428 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:32.767764 7428 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:32.770200 7128 ts_manager.cc:194] Registered new tserver with Master: 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719)
I20260812 11:20:32.771754 7128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:37887
W20260812 11:20:33.087893 7435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:33.088178 7435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:33.088338 7435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:33.095568 7435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:33.095676 7435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:33.095857 7435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:33.105530 7435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:46661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=44195
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:33.106961 7435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:33.108377 7435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:33.123003 7448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:33.122960 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:33.122983 7445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:33.123834 7435 server_base.cc:1034] running on GCE node
I20260812 11:20:33.124464 7435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:33.125423 7435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:33.126611 7435 hybrid_clock.cc:648] HybridClock initialized: now 1786533633126567 us; error 33 us; skew 500 ppm
I20260812 11:20:33.126960 7435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:33 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533633, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:33.130399 7435 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:33.132102 7435 webserver.cc:460] Webserver started at http://127.15.164.194:44195/ using document root <none> and password file <none>
I20260812 11:20:33.132882 7435 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:33.133062 7435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:33.139221 7435 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:20:33.142307 7456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.143746 7435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:33.143937 7435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "d5c7988dc722a62b3d1f95e53e13ed94"
server_key_iv: "1809f7c0a257befa4671b436aaad6e27"
server_key_version: "encryptionkey@0"
I20260812 11:20:33.145002 7435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:33.161608 7435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:33.165973 7435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:33.166272 7435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:33.167503 7435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:33.168874 7435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:33.169009 7435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.169145 7435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:33.169250 7435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.204176 7435 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46661
I20260812 11:20:33.204275 7636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46661 every 8 connection(s)
I20260812 11:20:33.205763 7435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:33.207751 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 7435
I20260812 11:20:33.208449 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:44763
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=33969
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:20:33 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533633, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:33.231511 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.208972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:40505 (local address 127.15.164.254:35067)
0812 11:20:33.209215 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.209222 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.210507 (+ 1285us) server_negotiation.cc:407] Connection header received
0812 11:20:33.213355 (+ 2848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.213359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.213443 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.213527 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:33.215765 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.216447 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.218995 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.219713 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.219838 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.223908 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:33.223918 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:33.223926 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:33.223982 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:33.227813 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.228626 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.228634 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.228640 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.228820 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.229266 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.229273 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.229279 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.229678 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:33.229859 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.230756 (+ 897us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.231029 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 11:20:33.232234 7640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.209360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:40505)
0812 11:20:33.210268 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.210322 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.213020 (+ 2698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.213817 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.213831 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.214702 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:33.215563 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.215600 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.216620 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.216628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.218821 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.218840 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.219989 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.219999 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.220333 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.221241 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:33.221274 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:33.223652 (+ 2378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:33.227990 (+ 4338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:33.227998 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:33.228012 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:33.228471 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:33.228938 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:33.228941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:33.228943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:33.229140 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:33.229853 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:33.229860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:33.230289 (+ 429us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.230599 (+ 310us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.231029 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":319,"threads_started":1}
I20260812 11:20:33.233956 7638 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:33.234306 7638 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:33.235138 7638 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:33.236810 7128 ts_manager.cc:194] Registered new tserver with Master: 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661)
I20260812 11:20:33.237653 7128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:40505
W20260812 11:20:33.558248 7641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:33.558643 7641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:33.558822 7641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:33.567387 7641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:33.567551 7641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:33.567755 7641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:33.578590 7641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:44763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=33969
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:33.580055 7641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:33.581485 7641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:33.595505 7647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:33.595481 7649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:33.595598 7646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:33.600219 7641 server_base.cc:1034] running on GCE node
I20260812 11:20:33.601109 7641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:33.602339 7641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:33.603652 7641 hybrid_clock.cc:648] HybridClock initialized: now 1786533633603621 us; error 73 us; skew 500 ppm
I20260812 11:20:33.604025 7641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:33 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533633, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:33.607362 7641 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:33.609045 7641 webserver.cc:460] Webserver started at http://127.15.164.195:33969/ using document root <none> and password file <none>
I20260812 11:20:33.609813 7641 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:33.609982 7641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:33.615731 7641 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:20:33.618741 7660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.620311 7641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:20:33.620503 7641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "61fbb71f25b34c739f86637db5e3e083"
format_stamp: "Formatted at 2026-08-12 11:20:30 on dist-test-slave-7kzw"
server_key: "f1f22b02fd05f30f27a5657607f55805"
server_key_iv: "e46909ed07a030503f39d964dc134b6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:33.621634 7641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:33.643949 7641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:33.648870 7641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:33.649178 7641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:33.650345 7641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:33.651907 7641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:33.652040 7641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.652175 7641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:33.652266 7641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:33.693213 7641 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44763
I20260812 11:20:33.693307 7833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44763 every 8 connection(s)
I20260812 11:20:33.694774 7641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:33.702970 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 7641
Aug 12 11:20:33 dist-test-slave-7kzw krb5kdc[6210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533633, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:33.717784 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.697403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:59593 (local address 127.15.164.254:35067)
0812 11:20:33.697628 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.697635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.698902 (+ 1267us) server_negotiation.cc:407] Connection header received
0812 11:20:33.700750 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.700754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.700826 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.700917 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:33.702406 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.703671 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.705852 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.706620 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.706771 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.710548 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:33.710556 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:33.710564 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:33.710609 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:33.714029 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.715041 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.715045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.715047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.715184 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.715761 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.715764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.715766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.716052 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:33.716158 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.717156 (+ 998us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.717385 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:20:33.718941 7840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.697965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:59593)
0812 11:20:33.698723 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.698780 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.700490 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.701121 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.701129 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.701610 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:33.702176 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.702194 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.703873 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.703880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.705694 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.705709 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.706886 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.706892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.707114 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.707884 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:33.707915 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:33.710289 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:33.714198 (+ 3909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:33.714210 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:33.714229 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:33.714920 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:33.715329 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:33.715333 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:33.715335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:33.715633 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:33.716208 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:33.716216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:33.716690 (+ 474us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.717033 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.717458 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":276,"threads_started":1}
I20260812 11:20:33.720225 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.704102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40964 (local address 127.15.164.254:35067)
0812 11:20:33.704627 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.704632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.704909 (+ 277us) server_negotiation.cc:407] Connection header received
0812 11:20:33.705104 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.705113 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.705173 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.705282 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:33.707308 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.708093 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.709430 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.709947 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.710081 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.713561 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:33.713568 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:33.713572 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:33.713616 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:33.716921 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.717725 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.717733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.717739 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.717998 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:33.718448 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:33.718453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:33.718456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:33.718817 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:33.719096 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.719564 (+ 468us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.719819 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":252,"threads_started":1}
I20260812 11:20:33.720743 7834 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35067
I20260812 11:20:33.721124 7834 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:33.722059 7834 heartbeater.cc:511] Master 127.15.164.254:35067 requested a full tablet report, sending...
I20260812 11:20:33.723663 7128 ts_manager.cc:194] Registered new tserver with Master: 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763)
I20260812 11:20:33.724490 7128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:59593
I20260812 11:20:33.736208 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:33.744118 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.737299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.15.164.254:35067)
0812 11:20:33.737594 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.737604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.738023 (+ 419us) server_negotiation.cc:407] Connection header received
0812 11:20:33.738265 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.738269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.738454 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.738671 (+ 217us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:20:33.739198 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.740087 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.741611 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.742048 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.742144 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.742955 (+ 811us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:20:33.743455 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:20:33.743567 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.743702 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.743788 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:20:33.745294 7128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:20:33.753212 7128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:20:33.775326 7428 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
I20260812 11:20:33.779675 7854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.767072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.15.164.194:46661)
0812 11:20:33.769073 (+ 2001us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.769087 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.770380 (+ 1293us) server_negotiation.cc:407] Connection header received
0812 11:20:33.770774 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.770786 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.771039 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.771238 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:33.772525 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.773658 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.776759 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.778300 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.778504 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.778698 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.779120 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.779306 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1849,"thread_start_us":1706,"threads_started":1}
I20260812 11:20:33.779862 7858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.768617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:34719 (local address 127.0.0.1:57126)
0812 11:20:33.771075 (+ 2458us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.771095 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.771223 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.771974 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.771980 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.772003 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:33.772665 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.772678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.774561 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.774571 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.776960 (+ 2389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.776976 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.778894 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.778904 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.779088 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.779121 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.779234 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.779394 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2338,"mutex_wait_us":23,"thread_start_us":2185,"threads_started":1}
I20260812 11:20:33.780411 7855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.767905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44763 (local address 127.0.0.1:55380)
0812 11:20:33.770200 (+ 2295us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.770243 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.770457 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.771323 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.771331 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.771359 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:33.772012 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.772029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.774220 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.774225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.777136 (+ 2911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.777152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.779372 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.779378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.779548 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.779583 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.779700 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.779854 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2122,"mutex_wait_us":65,"thread_start_us":1979,"threads_started":1}
I20260812 11:20:33.780565 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.768026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55380 (local address 127.15.164.195:44763)
0812 11:20:33.769685 (+ 1659us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.769695 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.770372 (+ 677us) server_negotiation.cc:407] Connection header received
0812 11:20:33.770736 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.770748 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.771046 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.772112 (+ 1066us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:33.772435 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.774056 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.777346 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.778849 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.779043 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.779203 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.779977 (+ 774us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.780181 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1459,"thread_start_us":1295,"threads_started":1}
I20260812 11:20:33.780848 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.766868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:46661 (local address 127.0.0.1:34032)
0812 11:20:33.770200 (+ 3332us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.770241 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.770538 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.771550 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.771554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.771580 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:33.772325 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.772341 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.773820 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.773827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.776550 (+ 2723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.776568 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.778615 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.778626 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.778842 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.778900 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.779062 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.779301 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":293,"thread_start_us":764,"threads_started":1}
I20260812 11:20:33.781387 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.769377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57126 (local address 127.15.164.193:34719)
0812 11:20:33.770098 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.770106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.771360 (+ 1254us) server_negotiation.cc:407] Connection header received
0812 11:20:33.771468 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.771476 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.771690 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.771887 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:33.772895 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.774385 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.777198 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.778541 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.778736 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.778897 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.780800 (+ 1903us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.780988 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":367,"threads_started":1}
I20260812 11:20:33.784538 7329 tablet_service.cc:1467] Processing CreateTablet for tablet 9d827feaad984383b3df941f1442eca5 (DEFAULT_TABLE table=test-table [id=7cee911e85a745c8bb6858a3282e8735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:33.784638 7538 tablet_service.cc:1467] Processing CreateTablet for tablet 9d827feaad984383b3df941f1442eca5 (DEFAULT_TABLE table=test-table [id=7cee911e85a745c8bb6858a3282e8735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:33.784634 7734 tablet_service.cc:1467] Processing CreateTablet for tablet 9d827feaad984383b3df941f1442eca5 (DEFAULT_TABLE table=test-table [id=7cee911e85a745c8bb6858a3282e8735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:33.786067 7538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d827feaad984383b3df941f1442eca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:33.786082 7329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d827feaad984383b3df941f1442eca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:33.786823 7734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d827feaad984383b3df941f1442eca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:33.800467 7861 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Bootstrap starting.
I20260812 11:20:33.801620 7863 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Bootstrap starting.
I20260812 11:20:33.804401 7861 tablet_bootstrap.cc:654] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:33.805306 7863 tablet_bootstrap.cc:654] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:33.805783 7861 log.cc:824] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:33.806648 7863 log.cc:824] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:33.808694 7864 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Bootstrap starting.
I20260812 11:20:33.809888 7861 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: No bootstrap required, opened a new log
I20260812 11:20:33.810246 7861 ts_tablet_manager.cc:1397] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260812 11:20:33.810873 7863 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: No bootstrap required, opened a new log
I20260812 11:20:33.811149 7863 ts_tablet_manager.cc:1397] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260812 11:20:33.811980 7864 tablet_bootstrap.cc:654] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:33.812995 7864 log.cc:824] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:33.815737 7864 tablet_bootstrap.cc:492] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: No bootstrap required, opened a new log
I20260812 11:20:33.816032 7864 ts_tablet_manager.cc:1397] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260812 11:20:33.821359 7861 raft_consensus.cc:348] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.821848 7861 raft_consensus.cc:374] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:33.821977 7861 raft_consensus.cc:729] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e91f0f6d9e340c9a9615208bf8306ea, State: Initialized, Role: FOLLOWER
I20260812 11:20:33.821857 7863 raft_consensus.cc:348] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.822275 7863 raft_consensus.cc:374] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:33.822393 7863 raft_consensus.cc:729] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7a7e8f98784e04bc61cfac489cec5e, State: Initialized, Role: FOLLOWER
I20260812 11:20:33.822821 7861 consensus_queue.cc:260] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.822996 7863 consensus_queue.cc:260] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.825049 7861 ts_tablet_manager.cc:1428] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260812 11:20:33.824813 7864 raft_consensus.cc:348] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.825265 7864 raft_consensus.cc:374] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:33.825382 7864 raft_consensus.cc:729] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fbb71f25b34c739f86637db5e3e083, State: Initialized, Role: FOLLOWER
I20260812 11:20:33.826174 7638 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
I20260812 11:20:33.826220 7864 consensus_queue.cc:260] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.826844 7863 ts_tablet_manager.cc:1428] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260812 11:20:33.828264 7834 heartbeater.cc:503] Master 127.15.164.254:35067 was elected leader, sending a full tablet report...
I20260812 11:20:33.829474 7864 ts_tablet_manager.cc:1428] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260812 11:20:33.920831 7876 raft_consensus.cc:482] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:33.921211 7876 raft_consensus.cc:504] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.923266 7876 leader_election.cc:288] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719), 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763)
I20260812 11:20:33.930862 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.924398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:50293 (local address 127.15.164.193:34719)
0812 11:20:33.924650 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.924659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.925418 (+ 759us) server_negotiation.cc:407] Connection header received
0812 11:20:33.925637 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.925644 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.925734 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.925850 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:33.926449 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.927236 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.929061 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.929854 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.930040 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.930126 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.930428 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.930591 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 11:20:33.931005 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.923467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:34719 (local address 127.15.164.194:50293)
0812 11:20:33.925294 (+ 1827us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.925311 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.925435 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.925865 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.925869 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.925894 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:33.926287 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.926296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.927387 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.927395 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.928897 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.928911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.930086 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.930092 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.930253 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.930281 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.930401 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.930556 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1665,"mutex_wait_us":1,"thread_start_us":1444,"threads_started":1}
I20260812 11:20:33.931097 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.923760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:52177 (local address 127.15.164.195:44763)
0812 11:20:33.924048 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.924058 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.925753 (+ 1695us) server_negotiation.cc:407] Connection header received
0812 11:20:33.925846 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.925850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.925912 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.926021 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:33.926813 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.927546 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.929251 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.930047 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.930245 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.930332 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.930686 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.930828 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 11:20:33.931617 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.923683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44763 (local address 127.15.164.194:52177)
0812 11:20:33.925466 (+ 1783us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:33.925495 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:33.925645 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:33.926046 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:33.926051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:33.926153 (+ 102us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:33.926648 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.926658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.927702 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.927707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.929080 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:33.929092 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.930275 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.930282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:33.930512 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.930549 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:20:33.930654 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:20:33.930791 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1613,"spinlock_wait_cycles":37248,"thread_start_us":1357,"threads_started":1}
I20260812 11:20:33.932322 7359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d827feaad984383b3df941f1442eca5" candidate_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" is_pre_election: true
I20260812 11:20:33.932687 7763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d827feaad984383b3df941f1442eca5" candidate_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbb71f25b34c739f86637db5e3e083" is_pre_election: true
I20260812 11:20:33.932881 7359 raft_consensus.cc:2454] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7a7e8f98784e04bc61cfac489cec5e in term 0.
I20260812 11:20:33.933218 7763 raft_consensus.cc:2454] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7a7e8f98784e04bc61cfac489cec5e in term 0.
I20260812 11:20:33.933666 7459 leader_election.cc:302] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e91f0f6d9e340c9a9615208bf8306ea, 5f7a7e8f98784e04bc61cfac489cec5e; no voters:
I20260812 11:20:33.934145 7876 raft_consensus.cc:2781] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:33.934307 7876 raft_consensus.cc:482] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:33.934424 7876 raft_consensus.cc:3037] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:33.937031 7876 raft_consensus.cc:504] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
I20260812 11:20:33.937681 7876 leader_election.cc:288] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [CANDIDATE]: Term 1 election: Requested vote from peers 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719), 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763)
I20260812 11:20:33.938212 7359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d827feaad984383b3df941f1442eca5" candidate_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
I20260812 11:20:33.938270 7763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d827feaad984383b3df941f1442eca5" candidate_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fbb71f25b34c739f86637db5e3e083"
I20260812 11:20:33.938419 7359 raft_consensus.cc:3037] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:33.938624 7763 raft_consensus.cc:3037] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:33.940733 7359 raft_consensus.cc:2454] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7a7e8f98784e04bc61cfac489cec5e in term 1.
I20260812 11:20:33.940991 7763 raft_consensus.cc:2454] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7a7e8f98784e04bc61cfac489cec5e in term 1.
I20260812 11:20:33.941236 7459 leader_election.cc:302] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e91f0f6d9e340c9a9615208bf8306ea, 5f7a7e8f98784e04bc61cfac489cec5e; no voters:
I20260812 11:20:33.941630 7876 raft_consensus.cc:2781] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:33.942054 7876 raft_consensus.cc:686] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 LEADER]: Becoming Leader. State: Replica: 5f7a7e8f98784e04bc61cfac489cec5e, State: Running, Role: LEADER
I20260812 11:20:33.942865 7876 consensus_queue.cc:237] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } }
W20260812 11:20:33.946375 7837 tablet.cc:2369] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:33.947840 7128 catalog_manager.cc:5495] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194). New cstate: current_term: 1 leader_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7a7e8f98784e04bc61cfac489cec5e" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 46661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 } health_report { overall_health: UNKNOWN } } }
W20260812 11:20:33.957866 7639 tablet.cc:2369] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:33.975140 7854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:33.969505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.15.164.194:46661)
0812 11:20:33.969792 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:33.969798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:33.969820 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:20:33.969963 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:33.969967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:33.970047 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:33.970216 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:20:33.970677 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.971419 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.972899 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:33.973301 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:33.973444 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:33.973955 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:20:33.974517 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:20:33.974722 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:33.974774 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 11:20:33.974863 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260812 11:20:33.984140 7359 raft_consensus.cc:1261] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Refusing update from remote peer 5f7a7e8f98784e04bc61cfac489cec5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:33.984140 7763 raft_consensus.cc:1261] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Refusing update from remote peer 5f7a7e8f98784e04bc61cfac489cec5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:33.985361 7882 consensus_queue.cc:1035] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fbb71f25b34c739f86637db5e3e083" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:33.985834 7876 consensus_queue.cc:1035] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e91f0f6d9e340c9a9615208bf8306ea" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 34719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:20:33.986630 7429 tablet.cc:2369] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:33.998581 7886 mvcc.cc:205] Tried to move back new op lower bound from 7317641764786909184 to 7317641764633903104. Current Snapshot: MvccSnapshot[applied={T|T < 7317641764786909184}]
I20260812 11:20:34.015131 7128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:34.015369 7128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:34.019104 7128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Sending DeleteTablet for 3 replicas of tablet 9d827feaad984383b3df941f1442eca5
I20260812 11:20:34.020504 7538 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d827feaad984383b3df941f1442eca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:34 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:34032
I20260812 11:20:34.020638 7329 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d827feaad984383b3df941f1442eca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:34 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57126
I20260812 11:20:34.020960 7734 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d827feaad984383b3df941f1442eca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:34 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:55380
I20260812 11:20:34.021453 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 7177
I20260812 11:20:34.033635 7904 tablet_replica.cc:330] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: stopping tablet replica
I20260812 11:20:34.034209 7904 raft_consensus.cc:2229] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:34.034363 7901 tablet_replica.cc:330] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: stopping tablet replica
I20260812 11:20:34.034768 7901 raft_consensus.cc:2229] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:20:34.034842 7904 raft_consensus.cc:2258] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:34.035857 7901 raft_consensus.cc:2258] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:34.036648 7903 tablet_replica.cc:330] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: stopping tablet replica
I20260812 11:20:34.037071 7903 raft_consensus.cc:2229] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:34.037593 7903 raft_consensus.cc:2258] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:34.038249 7901 ts_tablet_manager.cc:1905] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:34.039744 7903 ts_tablet_manager.cc:1905] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:34.045519 7904 ts_tablet_manager.cc:1905] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:34.046494 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:34.022370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57138 (local address 127.15.164.193:34719)
0812 11:20:34.022985 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:34.022991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:34.023012 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:20:34.023073 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:34.023079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:34.023168 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:34.023286 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:34.025562 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.026892 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.029057 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.029786 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.029928 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:34.036583 (+ 6655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:34.036602 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:34.036621 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:34.036680 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:34.041468 (+ 4788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.042578 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.042589 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.042593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.042794 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.043337 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.043343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.043346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.043901 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:34.044310 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:34.045302 (+ 992us) server_negotiation.cc:299] Negotiation successful
0812 11:20:34.045607 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475}
I20260812 11:20:34.046880 7903 ts_tablet_manager.cc:1918] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:34.047053 7903 log.cc:1196] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/9d827feaad984383b3df941f1442eca5
I20260812 11:20:34.047518 7419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:34.047678 7903 ts_tablet_manager.cc:1939] T 9d827feaad984383b3df941f1442eca5 P 2e91f0f6d9e340c9a9615208bf8306ea: Deleting consensus metadata
I20260812 11:20:34.051970 7901 ts_tablet_manager.cc:1918] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:34.052060 7904 ts_tablet_manager.cc:1918] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:34.052174 7901 log.cc:1196] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/9d827feaad984383b3df941f1442eca5
I20260812 11:20:34.052210 7904 log.cc:1196] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/9d827feaad984383b3df941f1442eca5
I20260812 11:20:34.052799 7901 ts_tablet_manager.cc:1939] T 9d827feaad984383b3df941f1442eca5 P 5f7a7e8f98784e04bc61cfac489cec5e: Deleting consensus metadata
I20260812 11:20:34.052791 7904 ts_tablet_manager.cc:1939] T 9d827feaad984383b3df941f1442eca5 P 61fbb71f25b34c739f86637db5e3e083: Deleting consensus metadata
I20260812 11:20:34.054590 7105 catalog_manager.cc:4841] TS 5f7a7e8f98784e04bc61cfac489cec5e (127.15.164.194:46661): tablet 9d827feaad984383b3df941f1442eca5 (table test-table [id=7cee911e85a745c8bb6858a3282e8735]) successfully deleted
I20260812 11:20:34.054966 7104 catalog_manager.cc:4841] TS 61fbb71f25b34c739f86637db5e3e083 (127.15.164.195:44763): tablet 9d827feaad984383b3df941f1442eca5 (table test-table [id=7cee911e85a745c8bb6858a3282e8735]) successfully deleted
I20260812 11:20:34.146893 7105 catalog_manager.cc:4841] TS 2e91f0f6d9e340c9a9615208bf8306ea (127.15.164.193:34719): tablet 9d827feaad984383b3df941f1442eca5 (table test-table [id=7cee911e85a745c8bb6858a3282e8735]) successfully deleted
I20260812 11:20:34.147663 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 7177
I20260812 11:20:34.176153 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 7435
I20260812 11:20:34.195851 7854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:34.176996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34052 (local address 127.15.164.194:46661)
0812 11:20:34.177184 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:34.177190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:34.177312 (+ 122us) server_negotiation.cc:407] Connection header received
0812 11:20:34.177585 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:34.177590 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:34.177677 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:34.177746 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:34.179773 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.181038 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.183007 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.183711 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.183809 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:34.187527 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:34.187545 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:34.187567 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:34.187620 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:34.192137 (+ 4517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.193037 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.193048 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.193052 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.193237 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.193707 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.193712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.193716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.194216 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:34.194549 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:34.195211 (+ 662us) server_negotiation.cc:299] Negotiation successful
0812 11:20:34.195447 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:20:34.196681 7632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:34.314671 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 7435
I20260812 11:20:34.342554 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 7641
I20260812 11:20:34.357161 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:34.343500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.15.164.195:44763)
0812 11:20:34.343737 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:34.343742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:34.343765 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:20:34.343853 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:34.343857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:34.343927 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:34.344037 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:34.345382 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.346142 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.347588 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:34.348014 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:34.348226 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:34.351238 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:34.351253 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:34.351270 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:34.351308 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:34.354042 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.354882 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.354889 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.354892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.355064 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:34.355471 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:34.355474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:34.355476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:34.355817 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:34.356149 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:34.356555 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:20:34.356832 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260812 11:20:34.357870 7828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:34.447930 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 7641
I20260812 11:20:34.476624 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 7083
I20260812 11:20:34.477906 7166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:34.596105 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 7083
I20260812 11:20:34.629101 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--webserver_interface=127.15.164.254
--webserver_port=38839
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:35067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:34.979274 7911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:34.979574 7911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:34.979664 7911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:34.986814 7911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:34.986915 7911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:34.986961 7911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:34.987020 7911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:34.987066 7911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:34.996737 7911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:35067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=38839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:34.997967 7911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:34.999311 7911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:35.011828 7922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:35.011914 7927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:35.011962 7921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:35.013046 7911 server_base.cc:1034] running on GCE node
I20260812 11:20:35.014002 7911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:35.015618 7911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:35.016899 7911 hybrid_clock.cc:648] HybridClock initialized: now 1786533635016843 us; error 66 us; skew 500 ppm
I20260812 11:20:35.017302 7911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:35 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533635, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:35.020826 7911 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:35.022436 7911 webserver.cc:460] Webserver started at http://127.15.164.254:38839/ using document root <none> and password file <none>
I20260812 11:20:35.023224 7911 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:35.023383 7911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:35.029167 7911 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:20:35.032244 7937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:35.033829 7911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:20:35.034044 7911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "aac34eba548d49f8b37b2ce599e399bf"
format_stamp: "Formatted at 2026-08-12 11:20:28 on dist-test-slave-7kzw"
server_key: "cd5d1aff9ff845de0b4df68890d1e755"
server_key_iv: "b74240c3767b23adf20f4080680f4d7d"
server_key_version: "encryptionkey@0"
I20260812 11:20:35.035246 7911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:35.051693 7911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:35.056332 7911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:35.056624 7911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:35.076782 7911 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:35067
I20260812 11:20:35.076804 8011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:35067 every 8 connection(s)
I20260812 11:20:35.078368 7911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:35.085357 8013 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:20:35.086072 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 7911
I20260812 11:20:35.087175 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:34719
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=41099
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:20:35.090512 8013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap starting.
I20260812 11:20:35.114667 8013 log.cc:824] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:35.131361 8013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:20:35.131923 8013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf: Bootstrap complete.
I20260812 11:20:35.141520 8013 raft_consensus.cc:348] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:35.142499 8013 raft_consensus.cc:729] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Initialized, Role: FOLLOWER
I20260812 11:20:35.143129 8013 consensus_queue.cc:260] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:35.143394 8013 raft_consensus.cc:388] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:35.143527 8013 raft_consensus.cc:482] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:35.143723 8013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:20:35.147647 8013 raft_consensus.cc:504] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:35.148176 8013 leader_election.cc:302] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aac34eba548d49f8b37b2ce599e399bf; no voters:
I20260812 11:20:35.148876 8013 leader_election.cc:288] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:20:35.149019 8017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:20:35.150148 8017 raft_consensus.cc:686] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [term 3 LEADER]: Becoming Leader. State: Replica: aac34eba548d49f8b37b2ce599e399bf, State: Running, Role: LEADER
I20260812 11:20:35.150779 8017 consensus_queue.cc:237] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } }
I20260812 11:20:35.151225 8013 sys_catalog.cc:564] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:35.153607 8018 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:35.153960 8018 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:35.154022 8019 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader aac34eba548d49f8b37b2ce599e399bf. Latest consensus state: current_term: 3 leader_uuid: "aac34eba548d49f8b37b2ce599e399bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac34eba548d49f8b37b2ce599e399bf" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35067 } } }
I20260812 11:20:35.154330 8019 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac34eba548d49f8b37b2ce599e399bf [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:35.155153 8025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:35.164351 8025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:35.166152 8025 catalog_manager.cc:1259] Loaded cluster ID: 8956e2021b8e4c51be9b127125974e25
I20260812 11:20:35.166317 8025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 11:20:35.168584 8025 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f981d4049ad google::LogMessage::Fail() at ??:0
@ 0x7f981d40788a google::LogMessage::SendToLog() at ??:0
@ 0x7f981d4044de google::LogMessage::Flush() at ??:0
@ 0x7f981d405a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9832e37512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9832e34976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9832ebc610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9832ebc439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9820050345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f982005391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9820053799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f982002eeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f98233086db start_thread at ??:0
@ 0x7f981c29e61f clone at ??:0
W20260812 11:20:35.512660 8015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:35.512948 8015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:35.513049 8015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:35.520365 8015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:35.520486 8015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:35.520610 8015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:35.530824 8015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:34719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=41099
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:35.532166 8015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:35.533468 8015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:35.547663 8071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:35.547703 8073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:35.547857 8075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:35.548723 8015 server_base.cc:1034] running on GCE node
I20260812 11:20:35.549449 8015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:35.550554 8015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:35.551779 8015 hybrid_clock.cc:648] HybridClock initialized: now 1786533635551716 us; error 53 us; skew 500 ppm
I20260812 11:20:35.552145 8015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:35 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533635, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:35.555563 8015 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:35.557179 8015 webserver.cc:460] Webserver started at http://127.15.164.193:41099/ using document root <none> and password file <none>
I20260812 11:20:35.557912 8015 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:35.558076 8015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:35.564407 8015 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260812 11:20:35.567690 8083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:35.569314 8015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:20:35.569468 8015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "2e91f0f6d9e340c9a9615208bf8306ea"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "45c70205b9db38ea1bc3d4da7debccd9"
server_key_iv: "cac7fac44d663902cf11f7d0e5e90a8a"
server_key_version: "encryptionkey@0"
I20260812 11:20:35.570626 8015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:35.586685 8015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:35.590850 8015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:35.591104 8015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:35.592200 8015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:35.593561 8015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:35.593650 8015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:35.593734 8015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:35.593796 8015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:35.631055 8015 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:34719
I20260812 11:20:35.631168 8260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:34719 every 8 connection(s)
I20260812 11:20:35.632740 8015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:35.638301 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:35.636260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:45287)
0812 11:20:35.637113 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:35.637364 (+ 251us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":341,"threads_started":1}
W20260812 11:20:35.639106 8261 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:35067 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:35067: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
I20260812 11:20:35.640045 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:35.639672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:49461)
0812 11:20:35.639854 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:35.639932 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:20:35.640991 8264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:35.640645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:58345)
0812 11:20:35.640793 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:35.640873 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:20:35.641266 8261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:20:35.642864 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 8015
I20260812 11:20:35.643478 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:46661
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=44195
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:36.291770 8265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:36.292637 8265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:36.292994 8265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:36.306238 8265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:36.306411 8265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:36.306790 8265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:36.323984 8265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:46661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=44195
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:36.326328 8265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:36.328776 8265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:36.351843 8272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:36.352066 8273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:36.351841 8276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:36.354290 8265 server_base.cc:1034] running on GCE node
I20260812 11:20:36.355515 8265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:36.357280 8265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:36.358832 8265 hybrid_clock.cc:648] HybridClock initialized: now 1786533636358689 us; error 142 us; skew 500 ppm
I20260812 11:20:36.359480 8265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:36 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533636, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:36.368702 8265 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:36.372041 8265 webserver.cc:460] Webserver started at http://127.15.164.194:44195/ using document root <none> and password file <none>
I20260812 11:20:36.373591 8265 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:36.373875 8265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:36.385370 8265 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.009s sys 0.000s
I20260812 11:20:36.391412 8289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:36.394573 8265 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260812 11:20:36.395020 8265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "5f7a7e8f98784e04bc61cfac489cec5e"
format_stamp: "Formatted at 2026-08-12 11:20:29 on dist-test-slave-7kzw"
server_key: "d5c7988dc722a62b3d1f95e53e13ed94"
server_key_iv: "1809f7c0a257befa4671b436aaad6e27"
server_key_version: "encryptionkey@0"
I20260812 11:20:36.397215 8265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:36.450446 8265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:36.459601 8265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:36.460085 8265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:36.461875 8265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:36.464407 8265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:36.464617 8265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:36.464848 8265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:36.465018 8265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:36.533877 8265 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:46661
I20260812 11:20:36.533954 8462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:46661 every 8 connection(s)
I20260812 11:20:36.537133 8265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:36.545261 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 8265
I20260812 11:20:36.546595 8469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:36.542805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:55571)
0812 11:20:36.544213 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:36.544800 (+ 587us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":500,"threads_started":1}
I20260812 11:20:36.546669 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:44763
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:35067
--webserver_port=33969
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:34741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:36.548266 8463 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:35067 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:35067: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
I20260812 11:20:36.549861 8469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:36.549293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:37805)
0812 11:20:36.549574 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:36.549684 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 11:20:36.551647 8469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:36.551034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:34889)
0812 11:20:36.551315 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:36.551452 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260812 11:20:36.552109 8463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:20:36.643985 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:36.642269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:57671)
0812 11:20:36.643232 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:36.643484 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":498,"threads_started":1}
W20260812 11:20:37.057152 8471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:37.057435 8471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:37.057608 8471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:37.065011 8471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:37.065131 8471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:37.065316 8471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:37.075220 8471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:34741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:44763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=33969
--tserver_master_addrs=127.15.164.254:35067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:37.076607 8471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:37.077994 8471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:37.091605 8480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:37.091605 8481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:37.091558 8484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:37.092559 8471 server_base.cc:1034] running on GCE node
I20260812 11:20:37.093184 8471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:37.094115 8471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:37.095366 8471 hybrid_clock.cc:648] HybridClock initialized: now 1786533637095316 us; error 60 us; skew 500 ppm
I20260812 11:20:37.095757 8471 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:37 dist-test-slave-7kzw krb5kdc[6210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533637, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:37.099460 8471 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:37.101044 8471 webserver.cc:460] Webserver started at http://127.15.164.195:33969/ using document root <none> and password file <none>
I20260812 11:20:37.101809 8471 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:37.101981 8471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:37.108273 8471 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:20:37.111308 8500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:37.112768 8471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:20:37.112973 8471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "61fbb71f25b34c739f86637db5e3e083"
format_stamp: "Formatted at 2026-08-12 11:20:30 on dist-test-slave-7kzw"
server_key: "f1f22b02fd05f30f27a5657607f55805"
server_key_iv: "e46909ed07a030503f39d964dc134b6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:37.114167 8471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:37.148514 8471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:37.153201 8471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:37.153496 8471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:37.154611 8471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:37.156178 8471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:37.156332 8471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:37.156440 8471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:37.156507 8471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:37.192935 8471 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44763
I20260812 11:20:37.193032 8678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44763 every 8 connection(s)
I20260812 11:20:37.194532 8471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:37.197172 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 8471
I20260812 11:20:37.200059 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:37.198002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:60095)
0812 11:20:37.198910 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:37.199218 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":421,"threads_started":1}
W20260812 11:20:37.200809 8680 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:35067 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:35067: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
I20260812 11:20:37.201622 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:37.201316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:39517)
0812 11:20:37.201456 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:37.201523 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:20:37.202687 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:37.202224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:37853)
0812 11:20:37.202389 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:37.202551 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 11:20:37.203014 8680 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:20:37.553620 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:37.552675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:47489)
0812 11:20:37.553209 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:37.553344 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":248,"threads_started":1}
I20260812 11:20:37.646258 8686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:37.645435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:45463)
0812 11:20:37.645997 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:37.646081 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":330,"threads_started":1}
I20260812 11:20:38.204576 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:38.203648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:42573)
0812 11:20:38.204152 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:38.204322 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":260,"threads_started":1}
I20260812 11:20:38.555620 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:38.554727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:38635)
0812 11:20:38.555234 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:38.555403 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":277,"threads_started":1}
I20260812 11:20:38.648057 8691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:38.647294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:55689)
0812 11:20:38.647786 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:38.647876 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":267,"threads_started":1}
I20260812 11:20:39.206563 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:39.205598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:57563)
0812 11:20:39.206213 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:39.206299 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":365,"threads_started":1}
I20260812 11:20:39.557308 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:39.556567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:50329)
0812 11:20:39.557023 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:39.557106 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":244,"threads_started":1}
I20260812 11:20:39.649680 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:39.648958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:56161)
0812 11:20:39.649401 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:39.649483 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":233,"threads_started":1}
I20260812 11:20:40.208550 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:40.207761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:46199)
0812 11:20:40.208277 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:40.208367 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":269,"threads_started":1}
I20260812 11:20:40.559082 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:40.558305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:43909)
0812 11:20:40.558815 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:40.558902 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":271,"threads_started":1}
I20260812 11:20:40.651526 8699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:40.650735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:51691)
0812 11:20:40.651248 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:40.651341 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":261,"threads_started":1}
I20260812 11:20:41.210655 8700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:41.209729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:44283)
0812 11:20:41.210261 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:41.210358 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":264,"threads_started":1}
I20260812 11:20:41.560892 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:41.560127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:57413)
0812 11:20:41.560606 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:41.560693 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":253,"threads_started":1}
I20260812 11:20:41.653293 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:41.652504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:52225)
0812 11:20:41.653026 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:41.653123 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":309,"threads_started":1}
I20260812 11:20:42.212713 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:42.211791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:42537)
0812 11:20:42.212417 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:42.212510 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":375,"threads_started":1}
I20260812 11:20:42.562888 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:42.562032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:42243)
0812 11:20:42.562576 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:42.562710 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":268,"threads_started":1}
I20260812 11:20:42.655635 8710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:42.654590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:50461)
0812 11:20:42.655185 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:42.655307 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":240,"threads_started":1}
I20260812 11:20:43.214710 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:43.213744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:47527)
0812 11:20:43.214299 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:43.214405 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":281,"threads_started":1}
I20260812 11:20:43.565188 8715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:43.564117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:35685)
0812 11:20:43.564738 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:43.564843 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":290,"threads_started":1}
I20260812 11:20:43.657287 8716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:43.656542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:40963)
0812 11:20:43.657011 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:43.657097 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":252,"threads_started":1}
I20260812 11:20:44.216813 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:44.215906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:56309)
0812 11:20:44.216432 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:44.216528 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":235,"threads_started":1}
I20260812 11:20:44.567009 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:44.566243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:36987)
0812 11:20:44.566745 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:44.566838 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":258,"threads_started":1}
I20260812 11:20:44.659135 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:44.658252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:55973)
0812 11:20:44.658850 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:44.658937 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":331,"threads_started":1}
I20260812 11:20:45.218657 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:45.217856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:43389)
0812 11:20:45.218319 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:45.218405 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":236,"threads_started":1}
I20260812 11:20:45.568712 8724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:45.567927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:54801)
0812 11:20:45.568415 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:45.568527 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":240,"threads_started":1}
I20260812 11:20:45.661279 8725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:45.660236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:34979)
0812 11:20:45.660910 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:45.661003 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":399,"threads_started":1}
I20260812 11:20:46.220444 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:46.219634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:48379)
0812 11:20:46.220126 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:46.220267 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":238,"threads_started":1}
I20260812 11:20:46.570605 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:46.569815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:36781)
0812 11:20:46.570269 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:46.570354 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":251,"threads_started":1}
I20260812 11:20:46.663091 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:46.662295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:36689)
0812 11:20:46.662805 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:46.662904 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":295,"threads_started":1}
I20260812 11:20:47.222164 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:47.221418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:48465)
0812 11:20:47.221892 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:47.221972 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":260,"threads_started":1}
I20260812 11:20:47.572275 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:47.571560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:44777)
0812 11:20:47.571998 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:47.572089 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":219,"threads_started":1}
I20260812 11:20:47.665215 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:47.664202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:39997)
0812 11:20:47.664797 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:47.664925 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":289,"threads_started":1}
I20260812 11:20:48.224118 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:48.223328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:52605)
0812 11:20:48.223818 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:48.223921 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":253,"threads_started":1}
I20260812 11:20:48.574057 8735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:48.573339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:54399)
0812 11:20:48.573814 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:48.573895 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":255,"threads_started":1}
I20260812 11:20:48.667333 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:48.666497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:40877)
0812 11:20:48.667010 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:48.667121 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":263,"threads_started":1}
I20260812 11:20:49.226339 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:49.225494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:49583)
0812 11:20:49.226085 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:49.226171 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":308,"threads_started":1}
I20260812 11:20:49.576228 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:49.575394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:58619)
0812 11:20:49.575912 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:49.576015 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":243,"threads_started":1}
I20260812 11:20:49.669543 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:49.668550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:51547)
0812 11:20:49.669187 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:49.669298 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":385,"threads_started":1}
I20260812 11:20:50.228446 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:50.227528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:49927)
0812 11:20:50.228140 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:50.228247 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":305,"threads_started":1}
I20260812 11:20:50.578294 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:50.577507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:34405)
0812 11:20:50.577993 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:50.578084 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":229,"threads_started":1}
I20260812 11:20:50.671860 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:50.671019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:55489)
0812 11:20:50.671539 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:50.671658 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":271,"threads_started":1}
I20260812 11:20:51.230378 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:51.229600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:49443)
0812 11:20:51.230086 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:51.230181 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":244,"threads_started":1}
I20260812 11:20:51.580374 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:51.579583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.194:59667)
0812 11:20:51.580078 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:51.580181 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":263,"threads_started":1}
I20260812 11:20:51.673583 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:51.672814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.193:53219)
0812 11:20:51.673322 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:51.673418 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":267,"threads_started":1}
I20260812 11:20:52.200687 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 8015
I20260812 11:20:52.226265 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:52.202051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45924 (local address 127.15.164.193:34719)
0812 11:20:52.202753 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:52.202801 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:52.202857 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:20:52.205582 (+ 2725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:52.205594 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:52.206066 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:52.206393 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:52.208193 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.209512 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.211009 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.211722 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.211875 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:52.219772 (+ 7897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:52.219781 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:52.219799 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:52.219847 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:52.222920 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.223712 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.223719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.223726 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.223902 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.224260 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.224263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.224265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.224835 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:52.225075 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:52.225478 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 11:20:52.225949 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":344,"threads_started":1}
I20260812 11:20:52.227705 8248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:52.232699 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:52.231769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35067 (local address 127.15.164.195:58711)
0812 11:20:52.232361 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:52.232479 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:35067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":273,"threads_started":1}
I20260812 11:20:52.316362 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 8015
I20260812 11:20:52.347148 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 8265
I20260812 11:20:52.365902 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:52.348247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39958 (local address 127.15.164.194:46661)
0812 11:20:52.348744 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:52.348762 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:52.348808 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:20:52.350358 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:52.350369 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:52.350885 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:52.351247 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:52.352775 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.354013 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.355402 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.356072 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.356306 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:52.359198 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:52.359207 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:52.359223 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:52.359278 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:52.362317 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.363113 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.363125 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.363139 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.363325 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.363755 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.363761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.363764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.364342 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:52.364699 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:52.365158 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 11:20:52.365590 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":204,"threads_started":1}
I20260812 11:20:52.367452 8458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:52.453464 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 8265
I20260812 11:20:52.480533 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 8471
I20260812 11:20:52.499523 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:52.481714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49352 (local address 127.15.164.195:44763)
0812 11:20:52.482285 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:52.482300 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:52.482344 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:20:52.484077 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:52.484087 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:52.484518 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:52.484804 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:52.486263 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.487707 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.489076 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:52.489716 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:52.489858 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:52.492762 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:52.492773 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:52.492788 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:52.492827 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:52.495793 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.496629 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.496636 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.496642 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.496810 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:52.497322 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:52.497326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:52.497329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:52.497922 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:52.498186 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:52.498749 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 11:20:52.499206 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":240,"threads_started":1}
I20260812 11:20:52.501055 8667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:52.588932 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 8471
2026-08-12T11:20:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25921 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:20:52 dist-test-slave-7kzw krb5kdc[8768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:20:52 dist-test-slave-7kzw krb5kdc[8768](info): set up 2 sockets
Aug 12 11:20:52 dist-test-slave-7kzw krb5kdc[8768](info): commencing operation
krb5kdc: starting...
W20260812 11:20:53.976918 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:20:54 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:20:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:20:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:20:54.276777 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:54.624590 8790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:54.624904 8790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:54.625000 8790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:54.632449 8790 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:20:54.632550 8790 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:20:54.632591 8790 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:20:54.632637 8790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:20:54.632694 8790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:54.632764 8790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:54.632809 8790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:20:54.632865 8790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:20:54.642921 8790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:54.644232 8790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:54.645629 8790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:54.658509 8797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:54.658509 8799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:54.658417 8801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:54.659372 8790 server_base.cc:1034] running on GCE node
I20260812 11:20:54.660104 8790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:54.661577 8790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:54.662799 8790 hybrid_clock.cc:648] HybridClock initialized: now 1786533654662741 us; error 29 us; skew 500 ppm
I20260812 11:20:54.663157 8790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:54 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:54.666543 8790 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:20:54.668107 8790 webserver.cc:460] Webserver started at http://127.15.164.254:44397/ using document root <none> and password file <none>
I20260812 11:20:54.668839 8790 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:54.668931 8790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:54.669277 8790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:54.672410 8790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "25b74734b2714ec38504dc49b953f873"
format_stamp: "Formatted at 2026-08-12 11:20:54 on dist-test-slave-7kzw"
server_key: "1bdc1893d69acbd18519c2eff1e8eaa6"
server_key_iv: "ae9385267a30986a1f00f78425da8f6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:54.673224 8790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "25b74734b2714ec38504dc49b953f873"
format_stamp: "Formatted at 2026-08-12 11:20:54 on dist-test-slave-7kzw"
server_key: "1bdc1893d69acbd18519c2eff1e8eaa6"
server_key_iv: "ae9385267a30986a1f00f78425da8f6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:54.678439 8790 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:20:54.682120 8810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:54.683535 8790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:20:54.683766 8790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "25b74734b2714ec38504dc49b953f873"
format_stamp: "Formatted at 2026-08-12 11:20:54 on dist-test-slave-7kzw"
server_key: "1bdc1893d69acbd18519c2eff1e8eaa6"
server_key_iv: "ae9385267a30986a1f00f78425da8f6f"
server_key_version: "encryptionkey@0"
I20260812 11:20:54.684005 8790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:54.721019 8790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:54.725564 8790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:54.725872 8790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:54.745988 8790 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44909
I20260812 11:20:54.745995 8904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44909 every 8 connection(s)
I20260812 11:20:54.747512 8790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:20:54.751739 8906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:54.755789 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 8790
I20260812 11:20:54.756023 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:20:54.756877 16019 external_mini_cluster.cc:1428] Setting key 31f632b9fcb0e1fbaf33e8c5dbc2c08c
I20260812 11:20:54.766309 8906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap starting.
I20260812 11:20:54.770509 8906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:54.772018 8906 log.cc:824] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:20:54 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:54.775853 8906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: No bootstrap required, opened a new log
I20260812 11:20:54.783244 8909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:54.759201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.15.164.254:44909)
0812 11:20:54.760054 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:54.760066 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:54.760107 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:20:54.761723 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:54.761748 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:54.762150 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:54.762556 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:54.764560 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:54.765920 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:54.767934 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:54.768633 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:54.768828 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:54.774955 (+ 6127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:54.774964 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:54.774981 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:54.775022 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:54.778519 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:54.779495 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:54.779502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:54.779509 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:54.779688 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:54.780186 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:54.780190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:54.780192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:54.780809 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:54.781064 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:54.781582 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 11:20:54.782073 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":415,"threads_started":1}
I20260812 11:20:54.785096 8906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:20:54.785488 8906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:54.785614 8906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Initialized, Role: FOLLOWER
I20260812 11:20:54.786192 8906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:20:54.786448 8906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:20:54.786676 8906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:20:54.786856 8906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:54.789359 8906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:20:54.789963 8906 leader_election.cc:302] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25b74734b2714ec38504dc49b953f873; no voters:
I20260812 11:20:54.790684 8906 leader_election.cc:288] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:20:54.790838 8913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:54.791566 8913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 LEADER]: Becoming Leader. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Running, Role: LEADER
I20260812 11:20:54.792224 8913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:20:54.792852 8906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:20:54.795135 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25b74734b2714ec38504dc49b953f873. Latest consensus state: current_term: 1 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:20:54.795239 8914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:20:54.795514 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:54.795639 8914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:20:54.798156 8925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:20:54.803982 8925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:20:54.813441 8925 catalog_manager.cc:1347] Generated new cluster ID: 36972204807c478495750f609975a5f6
I20260812 11:20:54.813658 8925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:20:54.831789 8925 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:20:54.833230 8925 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:20:54.841069 8925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Generated new TSK 0
I20260812 11:20:54.842151 8925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:20:54.919368 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:55.277068 8947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:55.277392 8947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:55.277490 8947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:55.285133 8947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:55.285269 8947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:55.285384 8947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:20:55.295722 8947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:55.297011 8947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:55.298707 8947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:55.312919 8959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:55.312883 8965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:55.312983 8956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:55.313778 8947 server_base.cc:1034] running on GCE node
I20260812 11:20:55.314615 8947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:55.315662 8947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:55.316924 8947 hybrid_clock.cc:648] HybridClock initialized: now 1786533655316845 us; error 65 us; skew 500 ppm
I20260812 11:20:55.317334 8947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:55 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:55.320711 8947 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:20:55.322099 8947 webserver.cc:460] Webserver started at http://127.15.164.193:34727/ using document root <none> and password file <none>
I20260812 11:20:55.322863 8947 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:55.322970 8947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:55.323251 8947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:55.326156 8947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "0d7c5315d317e597f7e1f8ea7a2c3e94"
server_key_iv: "d3b80f30a32486bec367021968698841"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.327024 8947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "0d7c5315d317e597f7e1f8ea7a2c3e94"
server_key_iv: "d3b80f30a32486bec367021968698841"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.332376 8947 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:20:55.335987 8977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.338016 8947 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:20:55.338250 8947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "0d7c5315d317e597f7e1f8ea7a2c3e94"
server_key_iv: "d3b80f30a32486bec367021968698841"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.338544 8947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:55.356004 8947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:55.360917 8947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:55.361251 8947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:55.362319 8947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:55.363852 8947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:55.363927 8947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.364130 8947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:55.364199 8947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.399907 8947 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:40739
I20260812 11:20:55.400003 9165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:40739 every 8 connection(s)
I20260812 11:20:55.401577 8947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:20:55.410378 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 8947
I20260812 11:20:55.410662 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:20:55.411360 16019 external_mini_cluster.cc:1428] Setting key 2756793ff93dcfbdddcbd2c0500614be
Aug 12 11:20:55 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:55.423484 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:55.404642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:35597 (local address 127.15.164.254:44909)
0812 11:20:55.405139 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:55.405144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:55.405993 (+ 849us) server_negotiation.cc:407] Connection header received
0812 11:20:55.407971 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:55.407977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:55.408074 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:55.408209 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:55.409798 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.410619 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.412322 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.412757 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.412913 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:55.417133 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:55.417139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:55.417142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:55.417176 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:55.420019 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:55.421037 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:55.421042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:55.421044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:55.421173 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:55.421682 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:55.421689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:55.421691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:55.421945 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:55.422053 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:55.423043 (+ 990us) server_negotiation.cc:299] Negotiation successful
0812 11:20:55.423222 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":267,"threads_started":1}
I20260812 11:20:55.424970 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:55.405049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:35597)
0812 11:20:55.405812 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:55.405856 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:55.407674 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:55.408461 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:55.408469 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:55.409034 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:55.409611 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:55.409629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.410823 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.410827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:55.412145 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:55.412158 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.413003 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.413013 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:55.413280 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:55.414026 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:55.414050 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:55.416896 (+ 2846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:55.420182 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:55.420195 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:55.420217 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:55.420902 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:55.421293 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:55.421300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:55.421307 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:55.421569 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:55.422077 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:55.422088 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:55.422612 (+ 524us) client_negotiation.cc:769] Sending connection context
0812 11:20:55.422948 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 11:20:55.423536 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":295,"threads_started":1}
I20260812 11:20:55.426699 9167 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:20:55.427042 9167 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:55.427968 9167 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:20:55.430668 8843 ts_manager.cc:194] Registered new tserver with Master: 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739)
I20260812 11:20:55.432920 8843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:35597
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:20:55.479243 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:55.836748 9174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:55.837108 9174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:55.837278 9174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:55.844929 9174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:55.845103 9174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:55.845291 9174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:20:55.855324 9174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:55.856678 9174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:55.858085 9174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:20:55.871977 9184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:55.872015 9186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:55.872043 9182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:55.872843 9174 server_base.cc:1034] running on GCE node
I20260812 11:20:55.873534 9174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:55.874568 9174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:55.875851 9174 hybrid_clock.cc:648] HybridClock initialized: now 1786533655875798 us; error 42 us; skew 500 ppm
I20260812 11:20:55.876238 9174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:55 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:55.879815 9174 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:20:55.881441 9174 webserver.cc:460] Webserver started at http://127.15.164.194:36541/ using document root <none> and password file <none>
I20260812 11:20:55.882169 9174 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:55.882328 9174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:55.882740 9174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:55.885768 9174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "8b03626aa60f43938ea761ae4c33e558"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "e583987998af97d6a153326bc164cc0f"
server_key_iv: "55a2250ae624697d0610f26b9f8e84d9"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.886621 9174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "8b03626aa60f43938ea761ae4c33e558"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "e583987998af97d6a153326bc164cc0f"
server_key_iv: "55a2250ae624697d0610f26b9f8e84d9"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.892364 9174 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:20:55.896113 9194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.897473 9174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:20:55.897661 9174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "8b03626aa60f43938ea761ae4c33e558"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "e583987998af97d6a153326bc164cc0f"
server_key_iv: "55a2250ae624697d0610f26b9f8e84d9"
server_key_version: "encryptionkey@0"
I20260812 11:20:55.897879 9174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:55.919626 9174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:55.924494 9174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:55.924821 9174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:55.925884 9174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:55.927466 9174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:55.927580 9174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.927740 9174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:55.927821 9174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:55.963376 9174 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:35751
I20260812 11:20:55.963474 9370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:35751 every 8 connection(s)
I20260812 11:20:55.964742 9174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:20:55.968401 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 9174
I20260812 11:20:55.968642 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:20:55.969266 16019 external_mini_cluster.cc:1428] Setting key cfa9b253b285bdfc8b791841eb4ee625
Aug 12 11:20:55 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:55.987525 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:55.967437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:58779 (local address 127.15.164.254:44909)
0812 11:20:55.967916 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:55.967921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:55.969023 (+ 1102us) server_negotiation.cc:407] Connection header received
0812 11:20:55.971375 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:55.971379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:55.971443 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:55.971581 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:55.973090 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.974319 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.975955 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.976726 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.976881 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:55.980434 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:55.980444 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:55.980452 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:55.980500 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:55.983861 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:55.984877 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:55.984882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:55.984884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:55.985015 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:55.985513 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:55.985516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:55.985518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:55.985774 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:55.985885 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:55.986952 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0812 11:20:55.987150 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":238,"threads_started":1}
I20260812 11:20:55.988958 9374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:55.967984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:58779)
0812 11:20:55.968828 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:55.968883 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:55.971045 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:55.971806 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:55.971815 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:55.972328 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:55.972895 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:55.972912 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.974526 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.974536 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:55.975792 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:55.975806 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:55.976948 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:55.976953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:55.977146 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:55.977866 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:55.977889 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:55.980190 (+ 2301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:55.984011 (+ 3821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:55.984022 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:55.984042 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:55.984703 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:55.985132 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:55.985140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:55.985147 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:55.985394 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:55.985906 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:55.985917 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:55.986383 (+ 466us) client_negotiation.cc:769] Sending connection context
0812 11:20:55.986723 (+ 340us) client_negotiation.cc:240] Negotiation successful
0812 11:20:55.987367 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":356,"threads_started":1}
I20260812 11:20:55.990578 9371 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:20:55.990923 9371 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:55.991679 9371 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:20:55.993422 8843 ts_manager.cc:194] Registered new tserver with Master: 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751)
I20260812 11:20:55.994791 8843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:58779
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:20:56.037918 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:20:56.408160 9377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:20:56.408557 9377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:20:56.408735 9377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:20:56.416672 9377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:20:56.416802 9377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:20:56.417006 9377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:20:56.427166 9377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:20:56.428540 9377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:20:56.429920 9377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:20:56.437041 9167 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
W20260812 11:20:56.444324 9386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.444401 9393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:20:56.444351 9391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:20:56.445386 9377 server_base.cc:1034] running on GCE node
I20260812 11:20:56.446087 9377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:20:56.447144 9377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:20:56.448434 9377 hybrid_clock.cc:648] HybridClock initialized: now 1786533656448373 us; error 89 us; skew 500 ppm
I20260812 11:20:56.448911 9377 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:20:56 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:20:56.452322 9377 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:20:56.453855 9377 webserver.cc:460] Webserver started at http://127.15.164.195:40933/ using document root <none> and password file <none>
I20260812 11:20:56.454658 9377 fs_manager.cc:359] Metadata directory not provided
I20260812 11:20:56.454823 9377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:20:56.455152 9377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:20:56.458197 9377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "41f98f2afc684ebf98695bb28c94cb3a"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-7kzw"
server_key: "dacb19dbdfcc9d6235cbae470c1e0499"
server_key_iv: "b51d9ea1cc44020dcc62a05524b79b27"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.459067 9377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "41f98f2afc684ebf98695bb28c94cb3a"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-7kzw"
server_key: "dacb19dbdfcc9d6235cbae470c1e0499"
server_key_iv: "b51d9ea1cc44020dcc62a05524b79b27"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.464306 9377 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:20:56.468137 9405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.469460 9377 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:20:56.469658 9377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "41f98f2afc684ebf98695bb28c94cb3a"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-7kzw"
server_key: "dacb19dbdfcc9d6235cbae470c1e0499"
server_key_iv: "b51d9ea1cc44020dcc62a05524b79b27"
server_key_version: "encryptionkey@0"
I20260812 11:20:56.469883 9377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:20:56.484112 9377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:20:56.488979 9377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:20:56.489282 9377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:20:56.490275 9377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:20:56.491731 9377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:20:56.491852 9377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.492008 9377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:20:56.492093 9377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:20:56.527715 9377 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44765
I20260812 11:20:56.527778 9596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44765 every 8 connection(s)
I20260812 11:20:56.529078 9377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:20:56.532327 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 9377
I20260812 11:20:56.532539 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:20:56.533072 16019 external_mini_cluster.cc:1428] Setting key f0e133f1f5e6b7481fe1846d26342eb3
Aug 12 11:20:56 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533656, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:20:56.550297 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.531782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:60479 (local address 127.15.164.254:44909)
0812 11:20:56.532363 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.532369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.533562 (+ 1193us) server_negotiation.cc:407] Connection header received
0812 11:20:56.535721 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.535725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.535806 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.535896 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.537469 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.538246 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.539834 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.540231 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.540336 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.544110 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.544114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.544118 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.544152 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.546852 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.547727 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.547733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.547735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.547946 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.548564 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.548573 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.548576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.548968 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.549133 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.549841 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.550010 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":302,"threads_started":1}
I20260812 11:20:56.551240 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.532374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:60479)
0812 11:20:56.533365 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.533424 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.535429 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.536185 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.536196 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.536728 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:20:56.537300 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.537318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.538386 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.538390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.539665 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.539678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.540431 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.540435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.540623 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.541365 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:20:56.541388 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:20:56.543844 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:20:56.547009 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.547016 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.547027 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.547580 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.548086 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:20:56.548090 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:20:56.548118 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:20:56.548413 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:20:56.549133 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:20:56.549141 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:20:56.549485 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.549712 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.550122 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":431,"threads_started":1}
I20260812 11:20:56.552657 9597 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:20:56.552994 9597 heartbeater.cc:464] Registering TS with master...
I20260812 11:20:56.553736 9597 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:20:56.555233 8843 ts_manager.cc:194] Registered new tserver with Master: 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765)
I20260812 11:20:56.556077 8843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:60479
I20260812 11:20:56.561564 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:20:56.579756 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.566561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.15.164.254:44909)
0812 11:20:56.566763 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.566767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.567315 (+ 548us) server_negotiation.cc:407] Connection header received
0812 11:20:56.567490 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.567496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.567577 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.567670 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.569182 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.569926 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.571392 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.571891 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.572004 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.574634 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.574639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.574642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.574675 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.577194 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.577831 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.577835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.577838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.577963 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.578301 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.578304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.578306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.578711 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.578903 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.579280 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.579469 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:20:56.584178 8843 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:20:56.591593 8843 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:20:56.627341 9624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.605381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52044 (local address 127.15.164.194:35751)
0812 11:20:56.618453 (+ 13072us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.618482 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.618514 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:20:56.618637 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.618648 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.618948 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.620020 (+ 1072us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:56.620292 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.621914 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.624774 (+ 2860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.626028 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.626239 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.626435 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.626784 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.626953 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12907,"thread_start_us":12782,"threads_started":1}
I20260812 11:20:56.627471 9622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.605412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:35751 (local address 127.0.0.1:52044)
0812 11:20:56.617702 (+ 12290us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.617726 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.617886 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.619233 (+ 1347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.619244 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.619288 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:56.619787 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.619801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.622073 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.622078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.624582 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.624602 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.626256 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.626262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.626537 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.626582 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.626737 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.626938 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12108,"mutex_wait_us":740,"thread_start_us":10197,"threads_started":1}
I20260812 11:20:56.628214 9627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.607696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44765 (local address 127.0.0.1:44924)
0812 11:20:56.619554 (+ 11858us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.619572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.619703 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.620671 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.620675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.620703 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:56.621057 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.621069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.623056 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.623063 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.625362 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.625378 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.627372 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.627379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.627581 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.627624 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.627691 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.627818 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11730,"mutex_wait_us":1,"thread_start_us":11548,"threads_started":1}
I20260812 11:20:56.629567 9629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.608455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44924 (local address 127.15.164.195:44765)
0812 11:20:56.619071 (+ 10616us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.619082 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.619843 (+ 761us) server_negotiation.cc:407] Connection header received
0812 11:20:56.619959 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.619966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.620190 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.620390 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:56.621299 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.622843 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.625553 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.627059 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.628800 (+ 1741us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.628976 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.629055 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.629211 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10422,"thread_start_us":10259,"threads_started":1}
I20260812 11:20:56.630684 9626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.605416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:44902)
0812 11:20:56.616845 (+ 11429us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.616901 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.617125 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.622262 (+ 5137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.622266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.622290 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:56.622730 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.622740 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.624712 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.624717 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.626660 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.626676 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.629846 (+ 3170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.629854 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.630028 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.630059 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.630150 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.630275 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11061,"mutex_wait_us":26,"thread_start_us":11931,"threads_started":1}
I20260812 11:20:56.631800 9274 tablet_service.cc:1467] Processing CreateTablet for tablet e5547013ab8a49d7b0deb5e0c611865f (DEFAULT_TABLE table=test-table [id=810d142ea48740e0bae579448c146253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:56.633215 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.605961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44902 (local address 127.15.164.193:40739)
0812 11:20:56.621686 (+ 15725us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.621695 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.621720 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:20:56.621807 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.621814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.622034 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.622256 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:56.622929 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.624559 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.626852 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.629312 (+ 2460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.629511 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.629690 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.632688 (+ 2998us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.632884 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15549,"thread_start_us":15399,"threads_started":1}
I20260812 11:20:56.633440 9274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5547013ab8a49d7b0deb5e0c611865f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:56.633316 9487 tablet_service.cc:1467] Processing CreateTablet for tablet e5547013ab8a49d7b0deb5e0c611865f (DEFAULT_TABLE table=test-table [id=810d142ea48740e0bae579448c146253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:56.634853 9487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5547013ab8a49d7b0deb5e0c611865f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:56.636350 9061 tablet_service.cc:1467] Processing CreateTablet for tablet e5547013ab8a49d7b0deb5e0c611865f (DEFAULT_TABLE table=test-table [id=810d142ea48740e0bae579448c146253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:20:56.637660 9061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5547013ab8a49d7b0deb5e0c611865f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:20:56.648734 9630 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Bootstrap starting.
I20260812 11:20:56.653273 9631 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Bootstrap starting.
I20260812 11:20:56.653612 9630 tablet_bootstrap.cc:654] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:56.654125 9633 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Bootstrap starting.
I20260812 11:20:56.655794 9630 log.cc:824] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:56.657711 9633 tablet_bootstrap.cc:654] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:56.657855 9631 tablet_bootstrap.cc:654] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Neither blocks nor log segments found. Creating new log.
I20260812 11:20:56.658656 9630 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: No bootstrap required, opened a new log
I20260812 11:20:56.658931 9630 ts_tablet_manager.cc:1397] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 11:20:56.659042 9631 log.cc:824] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:56.659041 9633 log.cc:824] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:20:56.661911 9633 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: No bootstrap required, opened a new log
I20260812 11:20:56.662200 9633 ts_tablet_manager.cc:1397] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260812 11:20:56.662312 9631 tablet_bootstrap.cc:492] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: No bootstrap required, opened a new log
I20260812 11:20:56.662586 9631 ts_tablet_manager.cc:1397] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:20:56.669906 9630 raft_consensus.cc:348] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.670392 9630 raft_consensus.cc:374] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:56.670557 9630 raft_consensus.cc:729] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b03626aa60f43938ea761ae4c33e558, State: Initialized, Role: FOLLOWER
I20260812 11:20:56.670610 9633 raft_consensus.cc:348] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.671093 9633 raft_consensus.cc:374] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:56.671231 9633 raft_consensus.cc:729] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b94d2fb7cb426d9cc804fcd35ef5d4, State: Initialized, Role: FOLLOWER
I20260812 11:20:56.671319 9630 consensus_queue.cc:260] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.671837 9633 consensus_queue.cc:260] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.672560 9371 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
I20260812 11:20:56.673183 9631 raft_consensus.cc:348] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.673591 9631 raft_consensus.cc:374] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:20:56.673761 9631 raft_consensus.cc:729] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f98f2afc684ebf98695bb28c94cb3a, State: Initialized, Role: FOLLOWER
I20260812 11:20:56.674338 9631 consensus_queue.cc:260] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.675448 9630 ts_tablet_manager.cc:1428] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260812 11:20:56.676470 9597 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
I20260812 11:20:56.677105 9631 ts_tablet_manager.cc:1428] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260812 11:20:56.679329 9633 ts_tablet_manager.cc:1428] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
W20260812 11:20:56.716969 9372 tablet.cc:2369] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:56.774012 9645 raft_consensus.cc:482] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:20:56.774416 9645 raft_consensus.cc:504] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.776399 9645 leader_election.cc:288] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751), 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765)
W20260812 11:20:56.780903 9598 tablet.cc:2369] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:20:56.784068 9629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.777170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:58933 (local address 127.15.164.195:44765)
0812 11:20:56.777409 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.777417 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.778054 (+ 637us) server_negotiation.cc:407] Connection header received
0812 11:20:56.778286 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.778290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.778350 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.778454 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:56.779150 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.779965 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.782028 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.783014 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.783225 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.783308 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.783688 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.783810 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:20:56.784124 9624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.776889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:39831 (local address 127.15.164.194:35751)
0812 11:20:56.777139 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.777147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.777956 (+ 809us) server_negotiation.cc:407] Connection header received
0812 11:20:56.778214 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.778218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.778280 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.778385 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:20:56.779013 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.779877 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.782207 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.783062 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.783239 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.783324 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.783726 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.783855 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:20:56.784240 9648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.777036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44765 (local address 127.15.164.193:58933)
0812 11:20:56.777929 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.777944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.778107 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.778493 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.778498 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.778529 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:56.778967 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.778977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.780111 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.780118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.781856 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.781869 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.783267 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.783273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.783496 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.783536 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.783654 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.783785 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":96,"thread_start_us":554,"threads_started":1}
I20260812 11:20:56.784492 9647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.776830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:35751 (local address 127.15.164.193:39831)
0812 11:20:56.777761 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0812 11:20:56.777791 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 11:20:56.778008 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:20:56.778409 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:20:56.778414 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:20:56.778440 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:20:56.778857 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.778868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.780032 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.780038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.782048 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:20:56.782061 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.783309 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.783315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:20:56.783539 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.783564 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:20:56.783682 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:20:56.783806 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":69,"thread_start_us":492,"threads_started":1}
I20260812 11:20:56.785445 9520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5547013ab8a49d7b0deb5e0c611865f" candidate_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f98f2afc684ebf98695bb28c94cb3a" is_pre_election: true
I20260812 11:20:56.785672 9308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5547013ab8a49d7b0deb5e0c611865f" candidate_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b03626aa60f43938ea761ae4c33e558" is_pre_election: true
I20260812 11:20:56.786118 9520 raft_consensus.cc:2454] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b94d2fb7cb426d9cc804fcd35ef5d4 in term 0.
I20260812 11:20:56.786216 9308 raft_consensus.cc:2454] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53b94d2fb7cb426d9cc804fcd35ef5d4 in term 0.
I20260812 11:20:56.786978 8979 leader_election.cc:302] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f98f2afc684ebf98695bb28c94cb3a, 53b94d2fb7cb426d9cc804fcd35ef5d4; no voters:
I20260812 11:20:56.787487 9645 raft_consensus.cc:2781] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:20:56.787643 9645 raft_consensus.cc:482] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:20:56.787762 9645 raft_consensus.cc:3037] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:56.790030 9645 raft_consensus.cc:504] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.790755 9645 leader_election.cc:288] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751), 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765)
I20260812 11:20:56.791159 9308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5547013ab8a49d7b0deb5e0c611865f" candidate_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b03626aa60f43938ea761ae4c33e558"
I20260812 11:20:56.791214 9520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5547013ab8a49d7b0deb5e0c611865f" candidate_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f98f2afc684ebf98695bb28c94cb3a"
I20260812 11:20:56.791371 9308 raft_consensus.cc:3037] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:56.791441 9520 raft_consensus.cc:3037] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:20:56.793751 9308 raft_consensus.cc:2454] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b94d2fb7cb426d9cc804fcd35ef5d4 in term 1.
I20260812 11:20:56.793861 9520 raft_consensus.cc:2454] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53b94d2fb7cb426d9cc804fcd35ef5d4 in term 1.
I20260812 11:20:56.794173 8980 leader_election.cc:302] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53b94d2fb7cb426d9cc804fcd35ef5d4, 8b03626aa60f43938ea761ae4c33e558; no voters:
I20260812 11:20:56.794557 9645 raft_consensus.cc:2781] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:20:56.795053 9645 raft_consensus.cc:686] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 LEADER]: Becoming Leader. State: Replica: 53b94d2fb7cb426d9cc804fcd35ef5d4, State: Running, Role: LEADER
I20260812 11:20:56.795542 9645 consensus_queue.cc:237] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } }
I20260812 11:20:56.800259 8843 catalog_manager.cc:5495] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193). New cstate: current_term: 1 leader_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } health_report { overall_health: UNKNOWN } } }
I20260812 11:20:56.820122 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.814612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.15.164.193:40739)
0812 11:20:56.814809 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.814814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.814834 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:20:56.814923 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.814927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.815004 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.815162 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:20:56.815562 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.816342 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.817813 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.818222 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.818318 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.819011 (+ 693us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:20:56.819553 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:20:56.819679 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.819832 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.819903 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:20:56.828573 9520 raft_consensus.cc:1261] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Refusing update from remote peer 53b94d2fb7cb426d9cc804fcd35ef5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:56.828567 9308 raft_consensus.cc:1261] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Refusing update from remote peer 53b94d2fb7cb426d9cc804fcd35ef5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:20:56.829567 9649 consensus_queue.cc:1035] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:56.829981 9645 consensus_queue.cc:1035] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:20:56.842255 9653 mvcc.cc:205] Tried to move back new op lower bound from 7317641858359095296 to 7317641858238156800. Current Snapshot: MvccSnapshot[applied={T|T < 7317641858359095296}]
I20260812 11:20:56.859645 8843 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:56.859947 8843 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:20:56.864475 8843 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Sending DeleteTablet for 3 replicas of tablet e5547013ab8a49d7b0deb5e0c611865f
I20260812 11:20:56.865868 9061 tablet_service.cc:1514] Processing DeleteTablet for tablet e5547013ab8a49d7b0deb5e0c611865f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:56 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:44902
I20260812 11:20:56.865904 9487 tablet_service.cc:1514] Processing DeleteTablet for tablet e5547013ab8a49d7b0deb5e0c611865f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:56 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:44924
I20260812 11:20:56.866529 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 8947
I20260812 11:20:56.866735 9274 tablet_service.cc:1514] Processing DeleteTablet for tablet e5547013ab8a49d7b0deb5e0c611865f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:20:56 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:52044
I20260812 11:20:56.877725 9676 tablet_replica.cc:330] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: stopping tablet replica
I20260812 11:20:56.878269 9676 raft_consensus.cc:2229] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:56.878898 9676 raft_consensus.cc:2258] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:56.881261 9674 tablet_replica.cc:330] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: stopping tablet replica
I20260812 11:20:56.881811 9674 raft_consensus.cc:2229] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:20:56.882422 9674 raft_consensus.cc:2258] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:56.883462 9672 tablet_replica.cc:330] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: stopping tablet replica
I20260812 11:20:56.884681 9672 raft_consensus.cc:2229] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:20:56.885411 9674 ts_tablet_manager.cc:1905] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:56.885423 9672 raft_consensus.cc:2258] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:20:56.885726 9676 ts_tablet_manager.cc:1905] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:56.891920 9672 ts_tablet_manager.cc:1905] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:20:56.892931 9674 ts_tablet_manager.cc:1918] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:56.893163 9674 log.cc:1196] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/e5547013ab8a49d7b0deb5e0c611865f
I20260812 11:20:56.893541 9676 ts_tablet_manager.cc:1918] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:56.893783 9674 ts_tablet_manager.cc:1939] T e5547013ab8a49d7b0deb5e0c611865f P 41f98f2afc684ebf98695bb28c94cb3a: Deleting consensus metadata
I20260812 11:20:56.893810 9676 log.cc:1196] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/e5547013ab8a49d7b0deb5e0c611865f
I20260812 11:20:56.894357 9676 ts_tablet_manager.cc:1939] T e5547013ab8a49d7b0deb5e0c611865f P 8b03626aa60f43938ea761ae4c33e558: Deleting consensus metadata
I20260812 11:20:56.896561 8813 catalog_manager.cc:4841] TS 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765): tablet e5547013ab8a49d7b0deb5e0c611865f (table test-table [id=810d142ea48740e0bae579448c146253]) successfully deleted
I20260812 11:20:56.896993 8815 catalog_manager.cc:4841] TS 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751): tablet e5547013ab8a49d7b0deb5e0c611865f (table test-table [id=810d142ea48740e0bae579448c146253]) successfully deleted
Aug 12 11:20:56 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:20:56.905350 9672 ts_tablet_manager.cc:1918] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:20:56.905632 9672 log.cc:1196] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/e5547013ab8a49d7b0deb5e0c611865f
I20260812 11:20:56.906243 9672 ts_tablet_manager.cc:1939] T e5547013ab8a49d7b0deb5e0c611865f P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting consensus metadata
I20260812 11:20:56.909053 8816 catalog_manager.cc:4841] TS 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739): tablet e5547013ab8a49d7b0deb5e0c611865f (table test-table [id=810d142ea48740e0bae579448c146253]) successfully deleted
I20260812 11:20:56.910799 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:56.867733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44914 (local address 127.15.164.193:40739)
0812 11:20:56.867922 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:56.867928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:56.879906 (+ 11978us) server_negotiation.cc:407] Connection header received
0812 11:20:56.880445 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:56.880454 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:56.880554 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:56.880659 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:56.882933 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.884246 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.887873 (+ 3627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:56.888614 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:56.888727 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:56.899727 (+ 11000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:56.899751 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:56.899778 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:56.899833 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:56.905640 (+ 5807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.906938 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.906952 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.906958 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.907192 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:56.907820 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:56.907827 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:56.907831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:56.908568 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:56.908902 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:56.910107 (+ 1205us) server_negotiation.cc:299] Negotiation successful
0812 11:20:56.910373 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:20:56.911580 9159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:57.015641 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 8947
I20260812 11:20:57.047345 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 9174
Aug 12 11:20:57 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:20:57.063727 9624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:57.048240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52058 (local address 127.15.164.194:35751)
0812 11:20:57.048487 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:57.048494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:57.048609 (+ 115us) server_negotiation.cc:407] Connection header received
0812 11:20:57.048856 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:57.048862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:57.048936 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:57.049050 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:57.050535 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:57.051313 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:57.052751 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:57.053158 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:57.053310 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:57.057990 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:57.058005 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:57.058029 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:57.058072 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:57.060882 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:57.061532 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:57.061539 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:57.061542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:57.061703 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:57.062055 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:57.062058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:57.062060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:57.062443 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:57.062996 (+ 553us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:57.063204 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 11:20:57.063379 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:20:57.064620 9365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:57.154138 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 9174
I20260812 11:20:57.183262 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 9377
Aug 12 11:20:57 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:20:57.200402 9629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:20:57.184201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44938 (local address 127.15.164.195:44765)
0812 11:20:57.184417 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:20:57.184423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:20:57.184445 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:20:57.184719 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:20:57.184725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:20:57.184816 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:20:57.184938 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:20:57.186425 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:57.187323 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:57.188749 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:20:57.189135 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:20:57.189241 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:20:57.194036 (+ 4795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:20:57.194051 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:20:57.194071 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:20:57.194105 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:20:57.197155 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:57.198000 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:57.198008 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:57.198011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:57.198163 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:20:57.198740 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:20:57.198744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:20:57.198746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:20:57.199126 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:20:57.199364 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 11:20:57.199759 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 11:20:57.199957 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:20:57.201155 9590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:57.294643 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 9377
I20260812 11:20:57.322515 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 8790
I20260812 11:20:57.323710 8898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:20:57.438405 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 8790
I20260812 11:21:17.472586 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--webserver_interface=127.15.164.254
--webserver_port=44397
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:17.837324 9684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:17.837633 9684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:17.837863 9684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:17.845218 9684 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:21:17.845316 9684 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:21:17.845409 9684 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:21:17.845511 9684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:17.845610 9684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:17.845734 9684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:17.845806 9684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:17.845890 9684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:17.857164 9684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=44397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:17.858723 9684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:17.860173 9684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:17.887243 9695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:17.887256 9698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:17.887305 9700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:17.887902 9684 server_base.cc:1034] running on GCE node
I20260812 11:21:17.888906 9684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:17.890802 9684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:17.892091 9684 hybrid_clock.cc:648] HybridClock initialized: now 1786533677891995 us; error 72 us; skew 500 ppm
I20260812 11:21:17.892552 9684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:17 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533677, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:17.896770 9684 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:21:17.898859 9684 webserver.cc:460] Webserver started at http://127.15.164.254:44397/ using document root <none> and password file <none>
I20260812 11:21:17.899760 9684 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:17.899947 9684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:17.906849 9684 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.003s
I20260812 11:21:17.910153 9714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:17.911729 9684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:17.911942 9684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "25b74734b2714ec38504dc49b953f873"
format_stamp: "Formatted at 2026-08-12 11:20:54 on dist-test-slave-7kzw"
server_key: "1bdc1893d69acbd18519c2eff1e8eaa6"
server_key_iv: "ae9385267a30986a1f00f78425da8f6f"
server_key_version: "encryptionkey@0"
I20260812 11:21:17.913079 9684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:17.934039 9684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:17.939257 9684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:17.939607 9684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:17.960757 9684 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44909
I20260812 11:21:17.960793 9792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44909 every 8 connection(s)
I20260812 11:21:17.962457 9684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:17.965042 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 9684
I20260812 11:21:17.966116 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:40739
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=34727
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:17.973628 9793 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:21:17.979202 9793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap starting.
I20260812 11:21:18.000247 9793 log.cc:824] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:18.013861 9793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:21:18.014566 9793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap complete.
I20260812 11:21:18.024430 9793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:18.025300 9793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Initialized, Role: FOLLOWER
I20260812 11:21:18.025966 9793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:18.026221 9793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:18.026348 9793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:18.026564 9793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:21:18.030647 9793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:18.031232 9793 leader_election.cc:302] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25b74734b2714ec38504dc49b953f873; no voters:
I20260812 11:21:18.031900 9793 leader_election.cc:288] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:21:18.032055 9799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:21:18.033406 9799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 LEADER]: Becoming Leader. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Running, Role: LEADER
I20260812 11:21:18.034088 9799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:18.034431 9793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:18.036934 9800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:21:18.037364 9800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:18.039214 9808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:18.039093 9802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25b74734b2714ec38504dc49b953f873. Latest consensus state: current_term: 2 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:21:18.039641 9802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:18.048206 9808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:18.049949 9808 catalog_manager.cc:1259] Loaded cluster ID: 36972204807c478495750f609975a5f6
I20260812 11:21:18.050165 9808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:18.054654 9808 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:18.056445 9808 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Loaded TSK: 0
I20260812 11:21:18.096397 9808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Generated new TSK 1
I20260812 11:21:18.096849 9808 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:21:18.354012 9796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:18.354357 9796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:18.354573 9796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:18.361855 9796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:18.362013 9796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:18.362192 9796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:21:18.372815 9796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:40739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=34727
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:18.374191 9796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:18.375663 9796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:18.391206 9846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.391285 9843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.391987 9841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.392470 9796 server_base.cc:1034] running on GCE node
I20260812 11:21:18.393172 9796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:18.394194 9796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:18.395437 9796 hybrid_clock.cc:648] HybridClock initialized: now 1786533678395363 us; error 63 us; skew 500 ppm
I20260812 11:21:18.395808 9796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:18 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:18.399462 9796 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:21:18.401121 9796 webserver.cc:460] Webserver started at http://127.15.164.193:34727/ using document root <none> and password file <none>
I20260812 11:21:18.401857 9796 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:18.402035 9796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:18.408342 9796 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:21:18.411573 9864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.413151 9796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:18.413364 9796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "0d7c5315d317e597f7e1f8ea7a2c3e94"
server_key_iv: "d3b80f30a32486bec367021968698841"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.414417 9796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:18.434128 9796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:18.438756 9796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:18.439041 9796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:18.440125 9796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:18.441535 9796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:18.441673 9796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.441802 9796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:18.441891 9796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.475980 9796 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:40739
I20260812 11:21:18.476070 10042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:40739 every 8 connection(s)
I20260812 11:21:18.477504 9796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:18.479359 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 9796
I20260812 11:21:18.479996 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:35751
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=36541
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:21:18 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:21:18.508002 10045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.483058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:49355 (local address 127.15.164.254:44909)
0812 11:21:18.483782 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:18.483801 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:18.484475 (+ 674us) server_negotiation.cc:407] Connection header received
0812 11:21:18.486778 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:18.486800 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:18.487279 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:18.487705 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:18.489209 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.491218 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.493242 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.493919 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.494066 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.499036 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:18.499046 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:18.499066 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:18.499112 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:18.502791 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.503836 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.503844 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.503850 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.504031 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:18.504671 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:18.504678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:18.504682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:18.505232 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:18.505397 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:18.506564 (+ 1167us) server_negotiation.cc:299] Negotiation successful
0812 11:21:18.506913 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":302,"threads_started":1}
I20260812 11:21:18.508479 10047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:18.483343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:49355)
0812 11:21:18.484267 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:18.484324 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:18.486109 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:18.487856 (+ 1747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:18.487863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:18.488412 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:18.488955 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.488973 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.491447 (+ 2474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.491452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.493065 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:18.493085 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:18.494185 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:18.494195 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:18.494575 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:18.495390 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:18.495425 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:18.498694 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:18.502957 (+ 4263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.502970 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.502991 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.503668 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.504180 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:18.504189 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:18.504195 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:18.504478 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:18.505416 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:18.505428 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:18.505935 (+ 507us) client_negotiation.cc:769] Sending connection context
0812 11:21:18.506304 (+ 369us) client_negotiation.cc:240] Negotiation successful
0812 11:21:18.506991 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":381,"threads_started":1}
I20260812 11:21:18.511812 10043 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:21:18.512214 10043 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:18.513073 10043 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:21:18.515667 9744 ts_manager.cc:194] Registered new tserver with Master: 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739)
I20260812 11:21:18.517464 9744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:49355
W20260812 11:21:18.853163 10048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:18.853545 10048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:18.853740 10048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:18.861075 10048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:18.861269 10048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:18.861475 10048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:21:18.871619 10048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:35751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=36541
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:18.873008 10048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:18.874433 10048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:18.889397 10056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.889421 10057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:18.889333 10059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:18.895645 10048 server_base.cc:1034] running on GCE node
I20260812 11:21:18.896456 10048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:18.897586 10048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:18.898828 10048 hybrid_clock.cc:648] HybridClock initialized: now 1786533678898773 us; error 42 us; skew 500 ppm
I20260812 11:21:18.899235 10048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:18 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:18.902854 10048 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:21:18.904403 10048 webserver.cc:460] Webserver started at http://127.15.164.194:36541/ using document root <none> and password file <none>
I20260812 11:21:18.905149 10048 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:18.905269 10048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:18.911461 10048 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:21:18.914841 10072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.916555 10048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:21:18.916764 10048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "8b03626aa60f43938ea761ae4c33e558"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "e583987998af97d6a153326bc164cc0f"
server_key_iv: "55a2250ae624697d0610f26b9f8e84d9"
server_key_version: "encryptionkey@0"
I20260812 11:21:18.917886 10048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:18.961763 10048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:18.966851 10048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:18.967177 10048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:18.968297 10048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:18.969775 10048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:18.969907 10048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:18.970049 10048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:18.970141 10048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.006108 10048 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:35751
I20260812 11:21:19.006232 10252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:35751 every 8 connection(s)
I20260812 11:21:19.007740 10048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:19.015376 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 10048
I20260812 11:21:19.016064 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:44765
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=40933
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:21:19 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533678, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:21:19.032979 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.010807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:54229 (local address 127.15.164.254:44909)
0812 11:21:19.011421 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.011427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.012245 (+ 818us) server_negotiation.cc:407] Connection header received
0812 11:21:19.014566 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.014573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.014701 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.014848 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.016890 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.018143 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.020322 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.021058 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.021207 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.025391 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.025400 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.025408 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.025459 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.028876 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.029977 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.029981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.029984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.030132 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.030747 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.030751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.030753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.031081 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.031431 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.032503 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.032702 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":337,"threads_started":1}
I20260812 11:21:19.034924 10258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.011202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:54229)
0812 11:21:19.012037 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.012095 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.014186 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.015146 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.015156 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.015818 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:19.016628 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.016649 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.018369 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.018374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.020155 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.020169 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.021298 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.021304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.021631 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.022557 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:19.022594 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:19.025131 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:19.029040 (+ 3909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.029052 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.029071 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.029833 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.030251 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.030259 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.030267 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.030578 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.031448 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:19.031460 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:19.032001 (+ 541us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.032408 (+ 407us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.033064 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":311,"threads_started":1}
I20260812 11:21:19.036602 10254 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:21:19.036963 10254 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:19.037770 10254 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:21:19.039426 9744 ts_manager.cc:194] Registered new tserver with Master: 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751)
I20260812 11:21:19.040337 9744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:54229
W20260812 11:21:19.404212 10260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:19.404500 10260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:19.404663 10260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:19.411950 10260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:19.412077 10260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:19.412253 10260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:21:19.422704 10260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:44765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=40933
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:19.424223 10260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:19.425532 10260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:19.440193 10267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.440196 10272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:19.440116 10269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:19.440899 10260 server_base.cc:1034] running on GCE node
I20260812 11:21:19.441560 10260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:19.442714 10260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:19.443967 10260 hybrid_clock.cc:648] HybridClock initialized: now 1786533679443905 us; error 51 us; skew 500 ppm
I20260812 11:21:19.444315 10260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:19 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533679, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:19.448100 10260 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:21:19.449760 10260 webserver.cc:460] Webserver started at http://127.15.164.195:40933/ using document root <none> and password file <none>
I20260812 11:21:19.450634 10260 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:19.450762 10260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:19.456199 10260 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:21:19.459087 10285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.460698 10260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:19.460903 10260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "41f98f2afc684ebf98695bb28c94cb3a"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-7kzw"
server_key: "dacb19dbdfcc9d6235cbae470c1e0499"
server_key_iv: "b51d9ea1cc44020dcc62a05524b79b27"
server_key_version: "encryptionkey@0"
I20260812 11:21:19.461962 10260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:19.477718 10260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:19.482590 10260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:19.482908 10260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:19.484056 10260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:19.485497 10260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:19.485600 10260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.485679 10260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:19.485745 10260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:19.521611 10043 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
I20260812 11:21:19.524413 10260 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44765
I20260812 11:21:19.524500 10469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44765 every 8 connection(s)
I20260812 11:21:19.526001 10260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:19.532733 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 10260
Aug 12 11:21:19 dist-test-slave-7kzw krb5kdc[8768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533679, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:21:19.549178 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.528697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:54429 (local address 127.15.164.254:44909)
0812 11:21:19.528879 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.528883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.530136 (+ 1253us) server_negotiation.cc:407] Connection header received
0812 11:21:19.532034 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.532040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.532131 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.532247 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.533967 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.534803 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.536867 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.537279 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.537415 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.541656 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.541664 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.541670 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.541732 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.545221 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.546260 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.546268 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.546272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.546437 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.547025 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.547029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.547031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.547464 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.547640 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.548569 (+ 929us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.548921 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:21:19.550664 10472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.529243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:54429)
0812 11:21:19.529974 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.530022 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.531763 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.532509 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.532517 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.533092 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:21:19.533771 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.533793 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.534965 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.534971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.536722 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.536734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.537511 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.537519 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.537747 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.538515 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:21:19.538545 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:21:19.541397 (+ 2852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:21:19.545359 (+ 3962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.545372 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.545394 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.546029 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.546618 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:21:19.546626 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:21:19.546630 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:21:19.546888 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:21:19.547636 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:21:19.547644 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:21:19.548137 (+ 493us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.548486 (+ 349us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.549058 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":291,"threads_started":1}
I20260812 11:21:19.552502 10470 heartbeater.cc:347] Connected to a master server at 127.15.164.254:44909
I20260812 11:21:19.552695 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.533728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.15.164.254:44909)
0812 11:21:19.535364 (+ 1636us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.535370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.535869 (+ 499us) server_negotiation.cc:407] Connection header received
0812 11:21:19.536061 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.536066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.536133 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.536241 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.537966 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.539083 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.540868 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.541479 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.541599 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.545240 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.545245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.545248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.545307 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.549190 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.550172 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.550176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.550178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.550306 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.550859 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.550868 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.550874 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.551306 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.551604 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.551939 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.552200 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1516,"spinlock_wait_cycles":12672,"thread_start_us":1391,"threads_started":1}
I20260812 11:21:19.552878 10470 heartbeater.cc:464] Registering TS with master...
I20260812 11:21:19.553745 10470 heartbeater.cc:511] Master 127.15.164.254:44909 requested a full tablet report, sending...
I20260812 11:21:19.555616 9743 ts_manager.cc:194] Registered new tserver with Master: 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765)
I20260812 11:21:19.556536 9743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:54429
I20260812 11:21:19.568213 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:21:19.575187 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.569280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45986 (local address 127.15.164.254:44909)
0812 11:21:19.569457 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.569461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.569956 (+ 495us) server_negotiation.cc:407] Connection header received
0812 11:21:19.570075 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.570079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.570236 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.570371 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:19.570906 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.571618 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.573182 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.573647 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.573746 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.574255 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:19.574663 (+ 408us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 11:21:19.574962 (+ 299us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45986: token expired
Metrics: {"server-negotiator.queue_time_us":62}
W20260812 11:21:19.575294 10473 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45986: token expired
W20260812 11:21:19.575986 9606 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.164.254:44909)
I20260812 11:21:19.589066 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.576547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45990 (local address 127.15.164.254:44909)
0812 11:21:19.576712 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.576716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.576734 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:21:19.576878 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.576881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.576937 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.577013 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.578523 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.579310 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.580684 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.581141 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.581242 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.583854 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.583860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.583863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.583896 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.586703 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.587319 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.587323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.587325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.587456 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.587782 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.587786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.587788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.588116 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.588303 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.588645 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.588825 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:21:19.592911 9743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45990:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:21:19.600467 9743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:21:19.624711 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.613419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.15.164.194:35751)
0812 11:21:19.614331 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.614341 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.615797 (+ 1456us) server_negotiation.cc:407] Connection header received
0812 11:21:19.616124 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.616135 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.616373 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.616552 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.617604 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.619155 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.621545 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.623046 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.623241 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.623451 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.624210 (+ 759us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.624391 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":1043,"threads_started":1}
I20260812 11:21:19.624913 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.612997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44765 (local address 127.0.0.1:36960)
0812 11:21:19.614740 (+ 1743us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.614797 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.614984 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.615897 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.615904 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.615941 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.616414 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.616430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.619284 (+ 2854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.619289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.621915 (+ 2626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.621931 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.623914 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.623920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.624119 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.624154 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.624231 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.624348 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1492,"mutex_wait_us":3,"thread_start_us":859,"threads_started":1}
I20260812 11:21:19.625442 10489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.613134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:35751 (local address 127.0.0.1:46972)
0812 11:21:19.615616 (+ 2482us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.615640 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.615914 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.616925 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.616930 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.616956 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.617383 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.617400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.619662 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.619666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.621286 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.621300 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.623620 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.623624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.623904 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.623993 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.624138 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.624348 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2350,"mutex_wait_us":49,"thread_start_us":2193,"threads_started":1}
I20260812 11:21:19.625473 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.613312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.15.164.195:44765)
0812 11:21:19.615173 (+ 1861us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.615184 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.615224 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:21:19.615338 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.615348 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.615600 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.616666 (+ 1066us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.616965 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.619087 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.622093 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.623652 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.623864 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.624048 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.624907 (+ 859us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.625083 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1678,"thread_start_us":1495,"threads_started":1}
I20260812 11:21:19.626636 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.615926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58422)
0812 11:21:19.617105 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.617131 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.617286 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.618786 (+ 1500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.618794 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.618825 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.619353 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.619366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.621420 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.621427 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.623875 (+ 2448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.623895 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.625789 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.625797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.625974 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.626006 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.626098 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.626216 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":990,"mutex_wait_us":30,"thread_start_us":837,"threads_started":1}
I20260812 11:21:19.627578 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.616536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.15.164.193:40739)
0812 11:21:19.618038 (+ 1502us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.618047 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.618075 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:21:19.618174 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.618180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.618333 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.619394 (+ 1061us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.619662 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.621272 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.624067 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.625541 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.625762 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.625918 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.626180 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.626299 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1317,"thread_start_us":1166,"threads_started":1}
I20260812 11:21:19.629462 10149 tablet_service.cc:1467] Processing CreateTablet for tablet d2fc85a4b5204e39b60b9efded455f36 (DEFAULT_TABLE table=test-table [id=ee4b4c28ceb347db9bcdab971e4231c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.629798 10362 tablet_service.cc:1467] Processing CreateTablet for tablet d2fc85a4b5204e39b60b9efded455f36 (DEFAULT_TABLE table=test-table [id=ee4b4c28ceb347db9bcdab971e4231c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.631175 10149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fc85a4b5204e39b60b9efded455f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.631217 10362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fc85a4b5204e39b60b9efded455f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.631098 9941 tablet_service.cc:1467] Processing CreateTablet for tablet d2fc85a4b5204e39b60b9efded455f36 (DEFAULT_TABLE table=test-table [id=ee4b4c28ceb347db9bcdab971e4231c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:21:19.632491 9941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fc85a4b5204e39b60b9efded455f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:21:19.643966 10497 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Bootstrap starting.
I20260812 11:21:19.646840 10498 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Bootstrap starting.
I20260812 11:21:19.648444 10499 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Bootstrap starting.
I20260812 11:21:19.649434 10497 tablet_bootstrap.cc:654] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.650590 10498 tablet_bootstrap.cc:654] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.650909 10497 log.cc:824] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.651786 10499 tablet_bootstrap.cc:654] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Neither blocks nor log segments found. Creating new log.
I20260812 11:21:19.651918 10498 log.cc:824] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.652901 10499 log.cc:824] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:19.654559 10497 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: No bootstrap required, opened a new log
I20260812 11:21:19.654856 10497 ts_tablet_manager.cc:1397] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 11:21:19.655853 10498 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: No bootstrap required, opened a new log
I20260812 11:21:19.656045 10499 tablet_bootstrap.cc:492] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: No bootstrap required, opened a new log
I20260812 11:21:19.656157 10498 ts_tablet_manager.cc:1397] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 11:21:19.656327 10499 ts_tablet_manager.cc:1397] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:21:19.665958 10497 raft_consensus.cc:348] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.666003 10498 raft_consensus.cc:348] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.666517 10497 raft_consensus.cc:374] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.666644 10498 raft_consensus.cc:374] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.666780 10498 raft_consensus.cc:729] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b03626aa60f43938ea761ae4c33e558, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.666783 10497 raft_consensus.cc:729] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f98f2afc684ebf98695bb28c94cb3a, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.667045 10499 raft_consensus.cc:348] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.667533 10499 raft_consensus.cc:374] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:21:19.667672 10499 raft_consensus.cc:729] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53b94d2fb7cb426d9cc804fcd35ef5d4, State: Initialized, Role: FOLLOWER
I20260812 11:21:19.667491 10498 consensus_queue.cc:260] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.667550 10497 consensus_queue.cc:260] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.668323 10499 consensus_queue.cc:260] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.672192 10470 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
I20260812 11:21:19.672930 10497 ts_tablet_manager.cc:1428] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260812 11:21:19.673864 10254 heartbeater.cc:503] Master 127.15.164.254:44909 was elected leader, sending a full tablet report...
I20260812 11:21:19.674494 10498 ts_tablet_manager.cc:1428] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Time spent starting tablet: real 0.018s user 0.019s sys 0.000s
I20260812 11:21:19.677066 10499 ts_tablet_manager.cc:1428] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Time spent starting tablet: real 0.021s user 0.014s sys 0.004s
W20260812 11:21:19.730053 10044 tablet.cc:2369] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:21:19.759981 10255 tablet.cc:2369] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:21:19.777937 10471 tablet.cc:2369] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:21:19.819597 10517 raft_consensus.cc:482] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:19.819959 10517 raft_consensus.cc:504] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.821831 10517 leader_election.cc:288] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751), 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739)
I20260812 11:21:19.828857 10472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.822100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.15.164.195:46381)
0812 11:21:19.822850 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.822870 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.823013 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.823412 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.823417 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.823447 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.823718 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.823729 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.824966 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.824970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.826859 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.826875 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.828247 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.828274 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.828442 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.828469 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.828547 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.828642 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":1}
I20260812 11:21:19.829043 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.822404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:46381 (local address 127.15.164.193:40739)
0812 11:21:19.822675 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.822680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.822955 (+ 275us) server_negotiation.cc:407] Connection header received
0812 11:21:19.823197 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.823206 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.823272 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.823382 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.823869 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.824830 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.827049 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.828097 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.828264 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.828352 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.828604 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.828779 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260812 11:21:19.829739 10516 raft_consensus.cc:482] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:21:19.830060 10519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.822946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:35751 (local address 127.15.164.195:47959)
0812 11:21:19.823814 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.823828 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.823923 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.824232 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.824235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.824255 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.824543 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.824550 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.825672 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.825679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.827469 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.827481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.829263 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.829271 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.829410 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.829434 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.829546 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.829669 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":26,"thread_start_us":484,"threads_started":1}
I20260812 11:21:19.830240 9974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "41f98f2afc684ebf98695bb28c94cb3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" is_pre_election: true
I20260812 11:21:19.830571 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.822317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:47959 (local address 127.15.164.194:35751)
0812 11:21:19.822627 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.822634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.823897 (+ 1263us) server_negotiation.cc:407] Connection header received
0812 11:21:19.824024 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.824029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.824105 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.824203 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.824707 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.825478 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.827637 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.828868 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.829012 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.829099 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.829585 (+ 486us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.829729 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:21:19.830525 10516 raft_consensus.cc:504] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.830883 9974 raft_consensus.cc:2454] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f98f2afc684ebf98695bb28c94cb3a in term 0.
I20260812 11:21:19.831684 10290 leader_election.cc:302] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f98f2afc684ebf98695bb28c94cb3a, 53b94d2fb7cb426d9cc804fcd35ef5d4; no voters:
I20260812 11:21:19.831609 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "41f98f2afc684ebf98695bb28c94cb3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b03626aa60f43938ea761ae4c33e558" is_pre_election: true
I20260812 11:21:19.832115 10517 raft_consensus.cc:2781] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:21:19.832087 10181 raft_consensus.cc:2454] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f98f2afc684ebf98695bb28c94cb3a in term 0.
I20260812 11:21:19.832274 10517 raft_consensus.cc:482] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:21:19.832391 10517 raft_consensus.cc:3037] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.834972 10516 leader_election.cc:288] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765), 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739)
I20260812 11:21:19.835765 10517 raft_consensus.cc:504] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.837069 10517 leader_election.cc:288] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [CANDIDATE]: Term 1 election: Requested vote from peers 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751), 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739)
I20260812 11:21:19.837113 9974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "41f98f2afc684ebf98695bb28c94cb3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
I20260812 11:21:19.837414 9974 raft_consensus.cc:3037] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.838991 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "41f98f2afc684ebf98695bb28c94cb3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b03626aa60f43938ea761ae4c33e558"
I20260812 11:21:19.839262 10181 raft_consensus.cc:3037] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:21:19.841706 9974 raft_consensus.cc:2454] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f98f2afc684ebf98695bb28c94cb3a in term 1.
I20260812 11:21:19.842151 10290 leader_election.cc:302] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f98f2afc684ebf98695bb28c94cb3a, 53b94d2fb7cb426d9cc804fcd35ef5d4; no voters:
I20260812 11:21:19.842530 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.833641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:48373 (local address 127.15.164.195:44765)
0812 11:21:19.833843 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.833849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.835137 (+ 1288us) server_negotiation.cc:407] Connection header received
0812 11:21:19.835480 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.835488 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.835571 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.835641 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.836480 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.837493 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.839816 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.841002 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.841124 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.841194 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.841890 (+ 696us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.842027 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:21:19.842816 10517 raft_consensus.cc:2781] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:21:19.842873 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.832963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:44765 (local address 127.15.164.194:48373)
0812 11:21:19.835037 (+ 2074us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.835058 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.835316 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.835884 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.835888 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.835923 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.836307 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.836322 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.837682 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.837686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.839634 (+ 1948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.839649 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.841433 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.841442 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.841669 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.841713 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.842187 (+ 474us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.842343 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1941,"mutex_wait_us":1,"thread_start_us":1692,"threads_started":1}
I20260812 11:21:19.843370 10517 raft_consensus.cc:686] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 1 LEADER]: Becoming Leader. State: Replica: 41f98f2afc684ebf98695bb28c94cb3a, State: Running, Role: LEADER
I20260812 11:21:19.842849 10181 raft_consensus.cc:2454] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f98f2afc684ebf98695bb28c94cb3a in term 1.
I20260812 11:21:19.844005 10517 consensus_queue.cc:237] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } }
I20260812 11:21:19.844074 10395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "8b03626aa60f43938ea761ae4c33e558" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f98f2afc684ebf98695bb28c94cb3a" is_pre_election: true
I20260812 11:21:19.846232 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.833175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:42855 (local address 127.15.164.193:40739)
0812 11:21:19.836997 (+ 3822us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.837002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.839094 (+ 2092us) server_negotiation.cc:407] Connection header received
0812 11:21:19.839309 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.839314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.839399 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.839510 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:21:19.840431 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.841561 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.844113 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.845190 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.845342 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.845395 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.845830 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.845958 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3714}
I20260812 11:21:19.846333 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.832963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.15.164.194:42855)
0812 11:21:19.838951 (+ 5988us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:19.838979 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:21:19.839114 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:21:19.839717 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:21:19.839726 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:21:19.839757 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:21:19.840224 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.840242 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.841757 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.841763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.843928 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:21:19.843943 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.845547 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.845552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:21:19.845675 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.845695 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:21:19.845804 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:21:19.845930 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5862,"mutex_wait_us":102,"thread_start_us":5583,"threads_started":1}
I20260812 11:21:19.846987 9974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fc85a4b5204e39b60b9efded455f36" candidate_uuid: "8b03626aa60f43938ea761ae4c33e558" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" is_pre_election: true
I20260812 11:21:19.847317 9974 raft_consensus.cc:2379] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b03626aa60f43938ea761ae4c33e558 in current term 1: Already voted for candidate 41f98f2afc684ebf98695bb28c94cb3a in this term.
I20260812 11:21:19.848120 10080 leader_election.cc:302] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b03626aa60f43938ea761ae4c33e558; no voters: 41f98f2afc684ebf98695bb28c94cb3a, 53b94d2fb7cb426d9cc804fcd35ef5d4
I20260812 11:21:19.848556 10516 raft_consensus.cc:2726] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 11:21:19.848982 9744 catalog_manager.cc:5495] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195). New cstate: current_term: 1 leader_uuid: "41f98f2afc684ebf98695bb28c94cb3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f98f2afc684ebf98695bb28c94cb3a" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 44765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 } health_report { overall_health: UNKNOWN } } }
I20260812 11:21:19.878196 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.872822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36976 (local address 127.15.164.195:44765)
0812 11:21:19.872993 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.872998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.873079 (+ 81us) server_negotiation.cc:407] Connection header received
0812 11:21:19.873280 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.873284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.873365 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.873505 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:21:19.873861 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.874638 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.876069 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.876459 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.876550 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.877110 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:21:19.877619 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:21:19.877763 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.877897 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.877962 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:21:19.887763 10181 raft_consensus.cc:1261] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Refusing update from remote peer 41f98f2afc684ebf98695bb28c94cb3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:19.887728 9974 raft_consensus.cc:1261] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Refusing update from remote peer 41f98f2afc684ebf98695bb28c94cb3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:21:19.888934 10522 consensus_queue.cc:1035] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:19.889374 10517 consensus_queue.cc:1035] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b03626aa60f43938ea761ae4c33e558" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:21:19.908375 10531 mvcc.cc:205] Tried to move back new op lower bound from 7317641952808271872 to 7317641952646107136. Current Snapshot: MvccSnapshot[applied={T|T < 7317641952808271872}]
I20260812 11:21:19.917402 9744 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:19.917752 9744 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:21:19.921669 9744 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Sending DeleteTablet for 3 replicas of tablet d2fc85a4b5204e39b60b9efded455f36
I20260812 11:21:19.922993 10362 tablet_service.cc:1514] Processing DeleteTablet for tablet d2fc85a4b5204e39b60b9efded455f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:36960
I20260812 11:21:19.923067 9941 tablet_service.cc:1514] Processing DeleteTablet for tablet d2fc85a4b5204e39b60b9efded455f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:58422
I20260812 11:21:19.923324 10149 tablet_service.cc:1514] Processing DeleteTablet for tablet d2fc85a4b5204e39b60b9efded455f36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:21:19 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:46972
I20260812 11:21:19.924441 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 9796
I20260812 11:21:19.933867 10540 tablet_replica.cc:330] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: stopping tablet replica
I20260812 11:21:19.934890 10540 raft_consensus.cc:2229] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:19.935627 10540 raft_consensus.cc:2258] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:19.938437 10540 ts_tablet_manager.cc:1905] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:19.945863 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:19.926152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.15.164.193:40739)
0812 11:21:19.926343 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:19.926350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:19.926369 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:21:19.926429 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:19.926433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:19.926556 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:19.926657 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:19.928936 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.930151 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.932244 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:19.932971 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:19.933099 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:19.937703 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:19.937718 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:19.937733 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:19.937769 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:19.940973 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.941947 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.941962 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.941965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.942139 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:19.942674 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:19.942680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:19.942683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:19.943178 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:19.943499 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:19.944855 (+ 1356us) server_negotiation.cc:299] Negotiation successful
0812 11:21:19.945121 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:21:19.947044 10033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:19.950785 10539 tablet_replica.cc:330] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: stopping tablet replica
I20260812 11:21:19.951450 10539 raft_consensus.cc:2229] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:21:19.952343 10539 raft_consensus.cc:2258] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:19.953408 10541 tablet_replica.cc:330] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: stopping tablet replica
I20260812 11:21:19.953962 10541 raft_consensus.cc:2229] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:21:19.954702 10541 raft_consensus.cc:2258] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:21:19.955193 10539 ts_tablet_manager.cc:1905] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:19.956707 10541 ts_tablet_manager.cc:1905] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:19.964104 10539 ts_tablet_manager.cc:1918] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:19.964391 10539 log.cc:1196] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/d2fc85a4b5204e39b60b9efded455f36
I20260812 11:21:19.964351 10541 ts_tablet_manager.cc:1918] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:19.964534 10541 log.cc:1196] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/d2fc85a4b5204e39b60b9efded455f36
I20260812 11:21:19.965039 10539 ts_tablet_manager.cc:1939] T d2fc85a4b5204e39b60b9efded455f36 P 41f98f2afc684ebf98695bb28c94cb3a: Deleting consensus metadata
I20260812 11:21:19.965147 10541 ts_tablet_manager.cc:1939] T d2fc85a4b5204e39b60b9efded455f36 P 8b03626aa60f43938ea761ae4c33e558: Deleting consensus metadata
I20260812 11:21:19.967348 9721 catalog_manager.cc:4841] TS 8b03626aa60f43938ea761ae4c33e558 (127.15.164.194:35751): tablet d2fc85a4b5204e39b60b9efded455f36 (table test-table [id=ee4b4c28ceb347db9bcdab971e4231c6]) successfully deleted
I20260812 11:21:19.967942 9719 catalog_manager.cc:4841] TS 41f98f2afc684ebf98695bb28c94cb3a (127.15.164.195:44765): tablet d2fc85a4b5204e39b60b9efded455f36 (table test-table [id=ee4b4c28ceb347db9bcdab971e4231c6]) successfully deleted
I20260812 11:21:20.050992 10540 ts_tablet_manager.cc:1918] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:20.051330 10540 log.cc:1196] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/d2fc85a4b5204e39b60b9efded455f36
I20260812 11:21:20.051913 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 9796
I20260812 11:21:20.052029 10540 ts_tablet_manager.cc:1939] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting consensus metadata
W20260812 11:21:20.079493 9722 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.164.193:40739 (error 108)
I20260812 11:21:20.079731 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 10048
I20260812 11:21:20.081786 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.081285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58430)
0812 11:21:20.081463 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.081575 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 11:21:20.083181 9722 catalog_manager.cc:4584] TS 53b94d2fb7cb426d9cc804fcd35ef5d4 (127.15.164.193:40739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d2fc85a4b5204e39b60b9efded455f36: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
I20260812 11:21:20.096573 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.080997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46974 (local address 127.15.164.194:35751)
0812 11:21:20.081199 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.081205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.081225 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:21:20.081298 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.081303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.081384 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.081497 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.083106 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.084271 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.085811 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.086658 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.086802 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.089582 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.089602 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.089625 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:20.089670 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.093612 (+ 3942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:20.094342 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:20.094352 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:20.094356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:20.094554 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:20.094923 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:20.094928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:20.094932 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:20.095414 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.095722 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.095941 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.096169 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:21:20.097337 10245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:20.137087 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.136496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58432)
0812 11:21:20.136744 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.136888 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:21:20.138428 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.137985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58434)
0812 11:21:20.138165 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.138277 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 11:21:20.191299 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 10048
I20260812 11:21:20.199908 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.199288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58444)
0812 11:21:20.199564 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.199678 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 11:21:20.202868 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.202265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58452)
0812 11:21:20.202544 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.202674 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:21:20.223958 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 10260
I20260812 11:21:20.241232 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.224864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36980 (local address 127.15.164.195:44765)
0812 11:21:20.225112 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:20.225118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:20.225142 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:21:20.225250 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:20.225255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:20.225342 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:20.225473 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:20.227112 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.228271 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.229877 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:20.230888 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:20.231039 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:20.233815 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:20.233831 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:20.233851 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:20.233905 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:20.237710 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:20.238562 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:20.238577 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:20.238587 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:20.238750 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:20.239283 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:20.239290 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:20.239294 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:20.239783 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:20.240204 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:20.240538 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 11:21:20.240820 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 11:21:20.242205 10465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:20.283790 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.283229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58462)
0812 11:21:20.283476 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.283586 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 11:21:20.285133 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.284634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58478)
0812 11:21:20.284856 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.284929 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 11:21:20.369282 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 10260
I20260812 11:21:20.398201 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 9684
I20260812 11:21:20.399626 9785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:20.520452 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 9684
I20260812 11:21:20.520479 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:20.519745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40739 (local address 127.0.0.1:58480)
0812 11:21:20.520103 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:20.520233 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260812 11:21:40.556500 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--webserver_interface=127.15.164.254
--webserver_port=44397
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:40.923704 10555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:40.924018 10555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:40.924199 10555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:40.931624 10555 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:21:40.931735 10555 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:21:40.931808 10555 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:21:40.931887 10555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:21:40.931983 10555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:40.932127 10555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:40.932202 10555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:21:40.932289 10555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:21:40.942657 10555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=44397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:40.944388 10555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:40.945940 10555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:40.959290 10563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:40.959197 10567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:40.959532 10562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:40.960598 10555 server_base.cc:1034] running on GCE node
I20260812 11:21:40.961457 10555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:40.963037 10555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:40.964268 10555 hybrid_clock.cc:648] HybridClock initialized: now 1786533700964199 us; error 46 us; skew 500 ppm
I20260812 11:21:40.964655 10555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:40 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:40.972749 10555 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:21:40.974411 10555 webserver.cc:460] Webserver started at http://127.15.164.254:44397/ using document root <none> and password file <none>
I20260812 11:21:40.975210 10555 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:40.975317 10555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:40.980973 10555 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 11:21:40.984041 10575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:40.985530 10555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:40.985774 10555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "25b74734b2714ec38504dc49b953f873"
format_stamp: "Formatted at 2026-08-12 11:20:54 on dist-test-slave-7kzw"
server_key: "1bdc1893d69acbd18519c2eff1e8eaa6"
server_key_iv: "ae9385267a30986a1f00f78425da8f6f"
server_key_version: "encryptionkey@0"
I20260812 11:21:40.986948 10555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:41.009855 10555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:41.014597 10555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:41.014945 10555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:41.035145 10555 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44909
I20260812 11:21:41.035181 10645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44909 every 8 connection(s)
I20260812 11:21:41.036741 10555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:21:41.040366 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 10555
I20260812 11:21:41.041297 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:40739
--local_ip_for_outbound_sockets=127.15.164.193
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=34727
--webserver_interface=127.15.164.193
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:41.044319 10647 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:21:41.047719 10647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap starting.
I20260812 11:21:41.069380 10647 log.cc:824] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Log is configured to *not* fsync() on all Append() calls
I20260812 11:21:41.086975 10647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:21:41.087574 10647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Bootstrap complete.
I20260812 11:21:41.097384 10647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:41.098387 10647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Initialized, Role: FOLLOWER
I20260812 11:21:41.099049 10647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:41.099326 10647 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:21:41.099465 10647 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:21:41.099665 10647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:21:41.103683 10647 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:41.104212 10647 leader_election.cc:302] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25b74734b2714ec38504dc49b953f873; no voters:
I20260812 11:21:41.104960 10647 leader_election.cc:288] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:21:41.105111 10654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:21:41.106263 10654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [term 3 LEADER]: Becoming Leader. State: Replica: 25b74734b2714ec38504dc49b953f873, State: Running, Role: LEADER
I20260812 11:21:41.106950 10654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } }
I20260812 11:21:41.107363 10647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:21:41.109833 10657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25b74734b2714ec38504dc49b953f873. Latest consensus state: current_term: 3 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:21:41.110147 10655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "25b74734b2714ec38504dc49b953f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b74734b2714ec38504dc49b953f873" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44909 } } }
I20260812 11:21:41.110625 10657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:41.110654 10655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:21:41.121853 10665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:21:41.133287 10665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:21:41.135471 10665 catalog_manager.cc:1259] Loaded cluster ID: 36972204807c478495750f609975a5f6
I20260812 11:21:41.135689 10665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:21:41.141268 10665 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:21:41.143622 10665 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Loaded TSK: 0
I20260812 11:21:41.143885 10665 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 25b74734b2714ec38504dc49b953f873: Loaded TSK: 1
F20260812 11:21:41.145429 10665 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f09c0d4f9ad google::LogMessage::Fail() at ??:0
@ 0x7f09c0d5288a google::LogMessage::SendToLog() at ??:0
@ 0x7f09c0d4f4de google::LogMessage::Flush() at ??:0
@ 0x7f09c0d50a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f09c4ab37d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
I20260812 11:21:41.163203 10685 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f09c4aa273e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f09d677e1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f09d677d783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f09d68092a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f09d68090c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f09d68535e9 std::function<>::operator()() at ??:0
@ 0x7f09d6781cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f09d677fc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f09d6807610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f09d6807439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f09c399b345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f09c399e91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f09c399e799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f09c3979eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f09c6c536db start_thread at ??:0
@ 0x7f09bfbe961f clone at ??:0
W20260812 11:21:41.449692 10649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:41.450003 10649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:41.450163 10649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:41.457742 10649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:41.457901 10649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:41.458326 10649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:21:41.468730 10649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:40739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=34727
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:41.470198 10649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:41.471599 10649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:41.485726 10722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:41.485682 10723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:41.485687 10726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:41.491544 10649 server_base.cc:1034] running on GCE node
I20260812 11:21:41.492304 10649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:41.493404 10649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:41.494619 10649 hybrid_clock.cc:648] HybridClock initialized: now 1786533701494560 us; error 35 us; skew 500 ppm
I20260812 11:21:41.495019 10649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:41 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533701, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:41.498799 10649 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:21:41.500577 10649 webserver.cc:460] Webserver started at http://127.15.164.193:34727/ using document root <none> and password file <none>
I20260812 11:21:41.501406 10649 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:41.501571 10649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:41.507607 10649 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:21:41.510819 10737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:41.512413 10649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:21:41.512604 10649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "53b94d2fb7cb426d9cc804fcd35ef5d4"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "0d7c5315d317e597f7e1f8ea7a2c3e94"
server_key_iv: "d3b80f30a32486bec367021968698841"
server_key_version: "encryptionkey@0"
I20260812 11:21:41.513613 10649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:41.534436 10649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:41.538816 10649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:41.539139 10649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:41.540231 10649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:41.542193 10750 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 11:21:41.548002 10750 ts_tablet_manager.cc:1852] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 11:21:41.549058 10750 ts_tablet_manager.cc:1905] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:21:41.556752 10750 ts_tablet_manager.cc:1918] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:21:41.557103 10750 ts_tablet_manager.cc:1939] T d2fc85a4b5204e39b60b9efded455f36 P 53b94d2fb7cb426d9cc804fcd35ef5d4: Deleting consensus metadata
I20260812 11:21:41.557560 10649 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 11:21:41.557691 10649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260812 11:21:41.557886 10649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:41.557986 10649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:41.594851 10649 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:40739
I20260812 11:21:41.594918 10918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:40739 every 8 connection(s)
I20260812 11:21:41.596271 10649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:21:41.601487 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.599568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:40597)
0812 11:21:41.600365 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.600605 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":337,"threads_started":1}
W20260812 11:21:41.602073 10919 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:44909 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:44909: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
I20260812 11:21:41.602584 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 10649
I20260812 11:21:41.603117 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.602717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:37699)
0812 11:21:41.602921 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.603000 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 11:21:41.603479 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:35751
--local_ip_for_outbound_sockets=127.15.164.194
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=36541
--webserver_interface=127.15.164.194
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:21:41.604190 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:41.603749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:40049)
0812 11:21:41.603914 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:41.604016 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:21:41.604460 10919 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:21:41.960518 10925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:41.960829 10925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:41.960997 10925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:41.968357 10925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:41.968468 10925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:41.968650 10925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:21:41.978538 10925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:35751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=36541
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:41.979914 10925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:41.981283 10925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:41.995543 10931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:41.995595 10936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:41.995645 10932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:41.996600 10925 server_base.cc:1034] running on GCE node
I20260812 11:21:41.997315 10925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:41.998377 10925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:41.999670 10925 hybrid_clock.cc:648] HybridClock initialized: now 1786533701999619 us; error 50 us; skew 500 ppm
I20260812 11:21:42.000044 10925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:42 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533702, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:42.003505 10925 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:21:42.005108 10925 webserver.cc:460] Webserver started at http://127.15.164.194:36541/ using document root <none> and password file <none>
I20260812 11:21:42.005849 10925 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:42.006002 10925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:42.011690 10925 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:21:42.014564 10943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.016096 10925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:21:42.016393 10925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "8b03626aa60f43938ea761ae4c33e558"
format_stamp: "Formatted at 2026-08-12 11:20:55 on dist-test-slave-7kzw"
server_key: "e583987998af97d6a153326bc164cc0f"
server_key_iv: "55a2250ae624697d0610f26b9f8e84d9"
server_key_version: "encryptionkey@0"
I20260812 11:21:42.017410 10925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:42.051005 10925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:42.056444 10925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:42.056808 10925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:42.058049 10925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:42.059721 10925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:42.059854 10925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.059994 10925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:42.060094 10925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.098052 10925 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:35751
I20260812 11:21:42.098078 11130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:35751 every 8 connection(s)
I20260812 11:21:42.099720 10925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:21:42.104437 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 10925
I20260812 11:21:42.104986 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.102955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:44467)
0812 11:21:42.103740 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.104031 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":301,"threads_started":1}
I20260812 11:21:42.105175 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:44765
--local_ip_for_outbound_sockets=127.15.164.195
--tserver_master_addrs=127.15.164.254:44909
--webserver_port=40933
--webserver_interface=127.15.164.195
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:21:42.105719 11131 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:44909 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:44909: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
I20260812 11:21:42.106681 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.106271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:60987)
0812 11:21:42.106436 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.106572 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:21:42.107571 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.107210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:58273)
0812 11:21:42.107373 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.107458 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 11:21:42.107806 11131 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:21:42.473728 11139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:21:42.474056 11139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:21:42.474243 11139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:21:42.482573 11139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:21:42.482692 11139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:21:42.482852 11139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:21:42.492997 11139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:44765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=40933
--tserver_master_addrs=127.15.164.254:44909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:21:42.494427 11139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:21:42.495853 11139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:21:42.509892 11161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:42.510006 11163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:21:42.510006 11159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:21:42.511118 11139 server_base.cc:1034] running on GCE node
I20260812 11:21:42.511842 11139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:21:42.512856 11139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:21:42.514107 11139 hybrid_clock.cc:648] HybridClock initialized: now 1786533702514053 us; error 73 us; skew 500 ppm
I20260812 11:21:42.514439 11139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:21:42 dist-test-slave-7kzw krb5kdc[8768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533702, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:21:42.517975 11139 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:21:42.519594 11139 webserver.cc:460] Webserver started at http://127.15.164.195:40933/ using document root <none> and password file <none>
I20260812 11:21:42.520336 11139 fs_manager.cc:359] Metadata directory not provided
I20260812 11:21:42.520493 11139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:21:42.526154 11139 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:21:42.529815 11178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.531410 11139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:21:42.531556 11139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "41f98f2afc684ebf98695bb28c94cb3a"
format_stamp: "Formatted at 2026-08-12 11:20:56 on dist-test-slave-7kzw"
server_key: "dacb19dbdfcc9d6235cbae470c1e0499"
server_key_iv: "b51d9ea1cc44020dcc62a05524b79b27"
server_key_version: "encryptionkey@0"
I20260812 11:21:42.532490 11139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:21:42.555467 11139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:21:42.560478 11139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:21:42.560724 11139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:21:42.561739 11139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:21:42.563284 11139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:21:42.563381 11139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.563463 11139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:21:42.563525 11139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:21:42.599535 11139 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:44765
I20260812 11:21:42.599570 11366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:44765 every 8 connection(s)
I20260812 11:21:42.601437 11139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:21:42.606177 11370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.605112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:53041)
0812 11:21:42.605708 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.605837 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":297,"threads_started":1}
I20260812 11:21:42.607224 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 11139
I20260812 11:21:42.608171 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.604969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:51595)
0812 11:21:42.606426 (+ 1457us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.606895 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":693,"threads_started":1}
W20260812 11:21:42.609126 11367 heartbeater.cc:644] Failed to heartbeat to 127.15.164.254:44909 (0 consecutive failures): Network error: Failed to ping master at 127.15.164.254:44909: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
I20260812 11:21:42.610092 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.609732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:45731)
0812 11:21:42.609889 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.609967 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:21:42.611172 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:42.610776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:34361)
0812 11:21:42.610937 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:42.611051 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:21:42.611542 11367 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:21:43.109427 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.108499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:58121)
0812 11:21:43.109039 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.109168 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":276,"threads_started":1}
I20260812 11:21:43.608032 11374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.607278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:56567)
0812 11:21:43.607753 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.607846 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":240,"threads_started":1}
I20260812 11:21:43.612984 11375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:43.612060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:48771)
0812 11:21:43.612627 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:43.612749 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":320,"threads_started":1}
I20260812 11:21:44.111274 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.110514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:47511)
0812 11:21:44.111012 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.111093 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":263,"threads_started":1}
I20260812 11:21:44.610080 11380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.609169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:48707)
0812 11:21:44.609748 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.609874 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":257,"threads_started":1}
I20260812 11:21:44.614660 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:44.613831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:35737)
0812 11:21:44.614353 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:44.614433 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":282,"threads_started":1}
I20260812 11:21:45.113060 11383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.112209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:60107)
0812 11:21:45.112697 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.112787 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":236,"threads_started":1}
I20260812 11:21:45.612062 11384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.611227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:42755)
0812 11:21:45.611762 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.611855 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":250,"threads_started":1}
I20260812 11:21:45.616294 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:45.615539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:41185)
0812 11:21:45.615996 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:45.616100 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":239,"threads_started":1}
I20260812 11:21:46.114790 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.113970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:55277)
0812 11:21:46.114440 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.114580 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":255,"threads_started":1}
I20260812 11:21:46.614049 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.613258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:44197)
0812 11:21:46.613802 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.613888 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":315,"threads_started":1}
I20260812 11:21:46.618214 11388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:46.617273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:34039)
0812 11:21:46.617861 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:46.617992 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":305,"threads_started":1}
I20260812 11:21:47.116639 11389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.115763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:38037)
0812 11:21:47.116327 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.116427 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":292,"threads_started":1}
I20260812 11:21:47.616055 11390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.615244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:52629)
0812 11:21:47.615723 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.615830 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":243,"threads_started":1}
I20260812 11:21:47.620002 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:47.619218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:39107)
0812 11:21:47.619737 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:47.619819 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":242,"threads_started":1}
I20260812 11:21:48.118690 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.117687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:39273)
0812 11:21:48.118287 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.118415 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":306,"threads_started":1}
I20260812 11:21:48.617969 11395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.617067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:43035)
0812 11:21:48.617662 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.617755 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":291,"threads_started":1}
I20260812 11:21:48.621788 11396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:48.621030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:49449)
0812 11:21:48.621515 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:48.621633 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":279,"threads_started":1}
I20260812 11:21:49.120734 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.119838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:48777)
0812 11:21:49.120399 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.120494 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":234,"threads_started":1}
I20260812 11:21:49.619830 11399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.619053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:43393)
0812 11:21:49.619552 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.619646 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":242,"threads_started":1}
I20260812 11:21:49.623739 11400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:49.622779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:40909)
0812 11:21:49.623403 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:49.623506 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":249,"threads_started":1}
I20260812 11:21:50.122735 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.121845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:41711)
0812 11:21:50.122357 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.122455 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":267,"threads_started":1}
I20260812 11:21:50.621882 11404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.620981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:35689)
0812 11:21:50.621607 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.621712 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":333,"threads_started":1}
I20260812 11:21:50.625413 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:50.624719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:46589)
0812 11:21:50.625158 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:50.625255 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":215,"threads_started":1}
I20260812 11:21:51.124490 11407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.123726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:40319)
0812 11:21:51.124191 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.124282 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":216,"threads_started":1}
I20260812 11:21:51.623981 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.623194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:52367)
0812 11:21:51.623697 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.623795 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":267,"threads_started":1}
I20260812 11:21:51.627132 11411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:51.626341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:54027)
0812 11:21:51.626874 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:51.626954 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":300,"threads_started":1}
I20260812 11:21:52.126152 11412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.125436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:49131)
0812 11:21:52.125879 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.125960 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":248,"threads_started":1}
I20260812 11:21:52.626142 11413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.625129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:50741)
0812 11:21:52.625824 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.625918 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":365,"threads_started":1}
I20260812 11:21:52.628964 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:52.628189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:51711)
0812 11:21:52.628710 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:52.628796 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":263,"threads_started":1}
I20260812 11:21:53.127930 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.127134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:39489)
0812 11:21:53.127632 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.127737 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":237,"threads_started":1}
I20260812 11:21:53.627894 11418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.627153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:43421)
0812 11:21:53.627605 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.627719 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":246,"threads_started":1}
I20260812 11:21:53.630786 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:53.629994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:45739)
0812 11:21:53.630407 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:53.630569 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":208,"threads_started":1}
I20260812 11:21:54.129823 11420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.128957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:35607)
0812 11:21:54.129528 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.129622 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":329,"threads_started":1}
I20260812 11:21:54.629843 11424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.628983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:58697)
0812 11:21:54.629544 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.629661 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":303,"threads_started":1}
I20260812 11:21:54.632468 11425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:54.631767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:50663)
0812 11:21:54.632226 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:54.632310 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":221,"threads_started":1}
I20260812 11:21:55.131809 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:55.130842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:51417)
0812 11:21:55.131484 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:55.131622 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":293,"threads_started":1}
I20260812 11:21:55.631826 11427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:55.631069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:33141)
0812 11:21:55.631528 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:55.631617 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":230,"threads_started":1}
I20260812 11:21:55.634284 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:55.633361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:46289)
0812 11:21:55.633903 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:55.634028 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":276,"threads_started":1}
I20260812 11:21:56.133986 11429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.132973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:48341)
0812 11:21:56.133700 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.133800 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":494,"threads_started":1}
I20260812 11:21:56.633992 11430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.633144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:36463)
0812 11:21:56.633703 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.633817 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":276,"threads_started":1}
I20260812 11:21:56.636096 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:56.635268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:37405)
0812 11:21:56.635782 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:56.635911 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":229,"threads_started":1}
I20260812 11:21:57.136273 11432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.135347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.194:53349)
0812 11:21:57.135919 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.136047 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":340,"threads_started":1}
I20260812 11:21:57.615252 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 10649
I20260812 11:21:57.636494 11434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.635045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.193:44131)
0812 11:21:57.635859 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.636112 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":488,"threads_started":1}
I20260812 11:21:57.637204 11433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.616448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57958 (local address 127.15.164.193:40739)
0812 11:21:57.617214 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.617240 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.617295 (+ 55us) server_negotiation.cc:407] Connection header received
0812 11:21:57.619612 (+ 2317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.619625 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.620119 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.620522 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:57.622274 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.623723 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.625347 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.626152 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.626308 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.629707 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:57.629716 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:57.629734 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:57.629783 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:57.632989 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.633750 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.633757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.633765 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.633959 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.634313 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.634317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.634319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.635168 (+ 849us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:57.635706 (+ 538us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.636195 (+ 489us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.636735 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":338,"threads_started":1}
I20260812 11:21:57.638228 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.637321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44909 (local address 127.15.164.195:35359)
0812 11:21:57.637845 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 11:21:57.638005 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.254:44909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"threads_started":1}
I20260812 11:21:57.639168 10914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:57.732734 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 10649
I20260812 11:21:57.763118 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 10925
I20260812 11:21:57.782829 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.764102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41256 (local address 127.15.164.194:35751)
0812 11:21:57.764656 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.764676 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.764717 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:21:57.766284 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.766295 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.766812 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.767194 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:57.768806 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.770098 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.771404 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.772062 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.772282 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.775336 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:57.775344 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:57.775362 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:57.775404 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:57.778769 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.779565 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.779573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.779581 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.779872 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.780377 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.780382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.780386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.781127 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:57.781465 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.782002 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.782505 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":254,"threads_started":1}
I20260812 11:21:57.784339 11125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:57.869153 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 10925
I20260812 11:21:57.901564 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 11139
I20260812 11:21:57.923300 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:21:57.902976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49166 (local address 127.15.164.195:44765)
0812 11:21:57.903656 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0812 11:21:57.903672 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:21:57.903718 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:21:57.905397 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:21:57.905407 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:21:57.906043 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:21:57.906366 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:21:57.908274 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.909565 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.911382 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:21:57.912223 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:21:57.912398 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:21:57.915701 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:21:57.915711 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:21:57.915730 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:21:57.915780 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:21:57.919366 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.920287 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.920295 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.920303 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.920487 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:21:57.920984 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:21:57.920988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:21:57.920990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:21:57.921612 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:21:57.921865 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 11:21:57.922440 (+ 575us) server_negotiation.cc:299] Negotiation successful
0812 11:21:57.922985 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":327,"threads_started":1}
I20260812 11:21:57.924922 11359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:21:58.012204 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 11139
2026-08-12T11:21:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65427 ms)
[----------] 30 tests from SecurityITest (320622 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:21:58 dist-test-slave-7kzw krb5kdc[11446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:21:58 dist-test-slave-7kzw krb5kdc[11446](info): set up 2 sockets
Aug 12 11:21:58 dist-test-slave-7kzw krb5kdc[11446](info): commencing operation
krb5kdc: starting...
W20260812 11:21:59.407852 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:21:59 dist-test-slave-7kzw krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:21:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:21:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:21:59.719976 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:36367
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:36367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:00.122359 11466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:00.122784 11466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:00.122995 11466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:00.130753 11466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:00.130872 11466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:00.130966 11466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:00.131065 11466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:00.131152 11466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:00.141780 11466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:36367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:36367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:00.143335 11466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:00.144763 11466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:00.160185 11478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:00.160252 11479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:00.160602 11481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:00.161459 11466 server_base.cc:1034] running on GCE node
I20260812 11:22:00.162417 11466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:00.164037 11466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:00.165288 11466 hybrid_clock.cc:648] HybridClock initialized: now 1786533720165222 us; error 65 us; skew 500 ppm
I20260812 11:22:00.165669 11466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:00 dist-test-slave-7kzw krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533720, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:00.169453 11466 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:00.171329 11466 webserver.cc:460] Webserver started at http://127.15.164.254:34683/ using document root <none> and password file <none>
I20260812 11:22:00.172071 11466 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:00.172225 11466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:00.172562 11466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:00.175812 11466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "36257ab5d73e402390c5a4503a63a077"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "1982a83d17838203cae66bdfe6ccaa82"
server_key_iv: "fac5ecad95b8b7d252af8579faab5553"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.176625 11466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "36257ab5d73e402390c5a4503a63a077"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "1982a83d17838203cae66bdfe6ccaa82"
server_key_iv: "fac5ecad95b8b7d252af8579faab5553"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.182941 11466 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:22:00.187033 11494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:00.188712 11466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:22:00.188917 11466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "36257ab5d73e402390c5a4503a63a077"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "1982a83d17838203cae66bdfe6ccaa82"
server_key_iv: "fac5ecad95b8b7d252af8579faab5553"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.189136 11466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:00.210003 11466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:00.220570 11466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:00.221007 11466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:00.244553 11466 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:36367
I20260812 11:22:00.244673 11590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:36367 every 8 connection(s)
I20260812 11:22:00.246140 11466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:00.251456 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 11466
I20260812 11:22:00.251751 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:00.251974 11592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:00.252564 16019 external_mini_cluster.cc:1428] Setting key 33a882173da9a829e0cc41f5cce680a8
I20260812 11:22:00.270967 11592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: Bootstrap starting.
I20260812 11:22:00.276297 11592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:00.277906 11592 log.cc:824] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:22:00 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:00.282225 11592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: No bootstrap required, opened a new log
I20260812 11:22:00.291109 11596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:00.255055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39862 (local address 127.15.164.254:36367)
0812 11:22:00.267066 (+ 12011us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:00.267091 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:00.267891 (+ 800us) server_negotiation.cc:407] Connection header received
0812 11:22:00.270037 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:00.270064 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:00.270584 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:00.271015 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:00.272767 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.274305 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.275869 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.276757 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.277016 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:00.282509 (+ 5493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:00.282524 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:00.282552 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:00.282596 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:00.286121 (+ 3525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:00.287055 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:00.287063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:00.287071 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:00.287288 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:00.287797 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:00.287801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:00.287803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:00.288380 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:00.288792 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:00.289327 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 11:22:00.289880 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11280,"thread_start_us":11247,"threads_started":1}
I20260812 11:22:00.296309 11592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } }
I20260812 11:22:00.296685 11592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:00.296754 11592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36257ab5d73e402390c5a4503a63a077, State: Initialized, Role: FOLLOWER
I20260812 11:22:00.297272 11592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } }
I20260812 11:22:00.297508 11592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:00.297605 11592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:00.297734 11592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:00.300112 11592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } }
I20260812 11:22:00.300789 11592 leader_election.cc:302] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36257ab5d73e402390c5a4503a63a077; no voters:
I20260812 11:22:00.301545 11592 leader_election.cc:288] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:00.301746 11598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:00.302510 11598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [term 1 LEADER]: Becoming Leader. State: Replica: 36257ab5d73e402390c5a4503a63a077, State: Running, Role: LEADER
I20260812 11:22:00.303249 11598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } }
I20260812 11:22:00.303984 11592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:00.306744 11601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36257ab5d73e402390c5a4503a63a077. Latest consensus state: current_term: 1 leader_uuid: "36257ab5d73e402390c5a4503a63a077" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } } }
I20260812 11:22:00.307164 11601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:00.307976 11599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36257ab5d73e402390c5a4503a63a077" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36257ab5d73e402390c5a4503a63a077" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 36367 } } }
I20260812 11:22:00.308305 11599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:00.311861 11607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:00.317919 11607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:00.326947 11607 catalog_manager.cc:1347] Generated new cluster ID: d71c95e58e114121b4bb9de8dfc2455d
I20260812 11:22:00.327075 11607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:00.361738 11607 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:00.363915 11607 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:00.375798 11607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: Generated new TSK 0
I20260812 11:22:00.376735 11607 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:22:00.460922 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:00.817198 11627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:00.817555 11627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:00.817729 11627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:00.825189 11627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:00.825351 11627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:00.825523 11627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:00.835938 11627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:00.837334 11627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:00.838807 11627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:00.852761 11642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:00.852726 11640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:00.853415 11639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:00.853581 11627 server_base.cc:1034] running on GCE node
I20260812 11:22:00.854295 11627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:00.855370 11627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:00.856654 11627 hybrid_clock.cc:648] HybridClock initialized: now 1786533720856571 us; error 67 us; skew 500 ppm
I20260812 11:22:00.857031 11627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:00 dist-test-slave-7kzw krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533720, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:00.860428 11627 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:22:00.861961 11627 webserver.cc:460] Webserver started at http://127.15.164.193:44595/ using document root <none> and password file <none>
I20260812 11:22:00.862780 11627 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:00.862931 11627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:00.863269 11627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:00.866389 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "a8144f4a8c50466cbed2294bae837f8b"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "35c107ef0b3b1b3f3907e85536fb6721"
server_key_iv: "9074cf8d2a933274bb3d639ec2b2fd53"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.867307 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "a8144f4a8c50466cbed2294bae837f8b"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "35c107ef0b3b1b3f3907e85536fb6721"
server_key_iv: "9074cf8d2a933274bb3d639ec2b2fd53"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.872882 11627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:00.877002 11652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:00.878575 11627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:22:00.878783 11627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "a8144f4a8c50466cbed2294bae837f8b"
format_stamp: "Formatted at 2026-08-12 11:22:00 on dist-test-slave-7kzw"
server_key: "35c107ef0b3b1b3f3907e85536fb6721"
server_key_iv: "9074cf8d2a933274bb3d639ec2b2fd53"
server_key_version: "encryptionkey@0"
I20260812 11:22:00.879012 11627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:00.893596 11627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:00.898006 11627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:00.898326 11627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:00.899524 11627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:00.900929 11627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:00.901041 11627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:00.901191 11627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:00.901278 11627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:00.938262 11627 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:37039
I20260812 11:22:00.938293 11845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:37039 every 8 connection(s)
I20260812 11:22:00.939656 11627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:00.945640 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 11627
I20260812 11:22:00.945881 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:00.946731 16019 external_mini_cluster.cc:1428] Setting key 1feb2dc521113115132dc27f1cd14d0b
Aug 12 11:22:00 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533720, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:00.964583 11849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:00.942940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:59955 (local address 127.15.164.254:36367)
0812 11:22:00.943471 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:00.943478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:00.944412 (+ 934us) server_negotiation.cc:407] Connection header received
0812 11:22:00.947024 (+ 2612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:00.947029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:00.947104 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:00.947221 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:00.949147 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.949909 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.952518 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.952952 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.953131 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:00.957935 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:00.957942 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:00.957945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:00.957995 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:00.960650 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:00.961739 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:00.961748 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:00.961754 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:00.961929 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:00.962393 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:00.962399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:00.962404 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:00.962892 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:00.963067 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:00.963806 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 11:22:00.964079 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":248,"threads_started":1}
I20260812 11:22:00.965230 11850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:00.943444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:36367 (local address 127.15.164.193:59955)
0812 11:22:00.944228 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:00.944274 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:00.946681 (+ 2407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:00.947531 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:00.947540 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:00.948227 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:00.948935 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:00.948983 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.950094 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.950100 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:00.952349 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:00.952368 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:00.953238 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:00.953248 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:00.953584 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:00.954401 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:00.954437 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:00.957649 (+ 3212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:00.960822 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:00.960834 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:00.960857 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:00.961520 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:00.962054 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:00.962057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:00.962060 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:00.962264 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:00.963042 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:00.963050 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:00.963388 (+ 338us) client_negotiation.cc:769] Sending connection context
0812 11:22:00.963626 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 11:22:00.964031 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":284,"threads_started":1}
I20260812 11:22:00.967063 11846 heartbeater.cc:347] Connected to a master server at 127.15.164.254:36367
I20260812 11:22:00.967427 11846 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:00.968338 11846 heartbeater.cc:511] Master 127.15.164.254:36367 requested a full tablet report, sending...
I20260812 11:22:00.970870 11529 ts_manager.cc:194] Registered new tserver with Master: a8144f4a8c50466cbed2294bae837f8b (127.15.164.193:37039)
I20260812 11:22:00.972406 11529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:59955
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:22:01.018214 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:01.367116 11853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:01.367416 11853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:01.367579 11853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:01.374620 11853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:01.374794 11853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:01.374986 11853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:01.384824 11853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:01.386036 11853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:01.387427 11853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:01.400936 11860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:01.400949 11861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:01.400915 11863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:01.401664 11853 server_base.cc:1034] running on GCE node
I20260812 11:22:01.402534 11853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:01.403739 11853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:01.404976 11853 hybrid_clock.cc:648] HybridClock initialized: now 1786533721404923 us; error 70 us; skew 500 ppm
I20260812 11:22:01.405326 11853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:01 dist-test-slave-7kzw krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533721, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:01.408756 11853 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:22:01.410327 11853 webserver.cc:460] Webserver started at http://127.15.164.194:46225/ using document root <none> and password file <none>
I20260812 11:22:01.411121 11853 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:01.411281 11853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:01.411664 11853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:01.414860 11853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "60da2e38f95049059161d198b31908ca"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "6f1fbdcdc6f2d6927b42f0f42477a55d"
server_key_iv: "bd0c48c92094ecc415479b6072ad3eb1"
server_key_version: "encryptionkey@0"
I20260812 11:22:01.415663 11853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "60da2e38f95049059161d198b31908ca"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "6f1fbdcdc6f2d6927b42f0f42477a55d"
server_key_iv: "bd0c48c92094ecc415479b6072ad3eb1"
server_key_version: "encryptionkey@0"
I20260812 11:22:01.421111 11853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 11:22:01.424820 11874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:01.426159 11853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:01.426353 11853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "60da2e38f95049059161d198b31908ca"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "6f1fbdcdc6f2d6927b42f0f42477a55d"
server_key_iv: "bd0c48c92094ecc415479b6072ad3eb1"
server_key_version: "encryptionkey@0"
I20260812 11:22:01.426666 11853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:01.457916 11853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:01.462577 11853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:01.462903 11853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:01.463956 11853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:01.465495 11853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:01.465605 11853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:01.465764 11853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:01.465863 11853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:01.502068 11853 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:42351
I20260812 11:22:01.502122 12044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:42351 every 8 connection(s)
I20260812 11:22:01.503508 11853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:01.508879 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 11853
I20260812 11:22:01.509088 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:01.509622 16019 external_mini_cluster.cc:1428] Setting key 453597e7ecd8fcb85168dade0e5d8f77
Aug 12 11:22:01 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533721, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:01.526998 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:01.506253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:35343 (local address 127.15.164.254:36367)
0812 11:22:01.506789 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:01.506796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:01.507720 (+ 924us) server_negotiation.cc:407] Connection header received
0812 11:22:01.509686 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:01.509692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:01.509794 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:01.509923 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:01.512071 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:01.513267 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:01.514941 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:01.515733 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:01.515884 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:01.519627 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:01.519636 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:01.519644 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:01.519696 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:01.523452 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:01.524323 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:01.524332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:01.524346 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:01.524536 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:01.524988 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:01.524996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:01.525002 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:01.525392 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:01.525509 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:01.526520 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0812 11:22:01.526723 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":262,"threads_started":1}
I20260812 11:22:01.528563 12050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:01.506821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:36367 (local address 127.15.164.194:35343)
0812 11:22:01.507558 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:01.507597 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:01.509385 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:01.510124 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:01.510132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:01.510910 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:01.511816 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:01.511847 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:01.513426 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:01.513430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:01.514793 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:01.514806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:01.515949 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:01.515954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:01.516157 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:01.516884 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:01.516906 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:01.519347 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:01.523622 (+ 4275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:01.523630 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:01.523644 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:01.524180 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:01.524654 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:01.524657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:01.524660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:01.524860 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:01.525529 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:01.525539 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:01.526023 (+ 484us) client_negotiation.cc:769] Sending connection context
0812 11:22:01.526362 (+ 339us) client_negotiation.cc:240] Negotiation successful
0812 11:22:01.527015 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":283,"threads_started":1}
I20260812 11:22:01.530447 12045 heartbeater.cc:347] Connected to a master server at 127.15.164.254:36367
I20260812 11:22:01.530848 12045 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:01.531900 12045 heartbeater.cc:511] Master 127.15.164.254:36367 requested a full tablet report, sending...
I20260812 11:22:01.533849 11529 ts_manager.cc:194] Registered new tserver with Master: 60da2e38f95049059161d198b31908ca (127.15.164.194:42351)
I20260812 11:22:01.535284 11529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:35343
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:22:01.581641 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:01.938655 12055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:01.938927 12055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:01.939102 12055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:01.947336 12055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:01.947440 12055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:01.947613 12055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:01.957360 12055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:36367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:01.958777 12055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:01.960132 12055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:01.973757 12065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:01.973706 12068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:01.973675 12066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:01.974761 12055 server_base.cc:1034] running on GCE node
I20260812 11:22:01.975427 12055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:01.976243 11846 heartbeater.cc:503] Master 127.15.164.254:36367 was elected leader, sending a full tablet report...
I20260812 11:22:01.976548 12055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:01.977802 12055 hybrid_clock.cc:648] HybridClock initialized: now 1786533721977731 us; error 58 us; skew 500 ppm
I20260812 11:22:01.978263 12055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:01 dist-test-slave-7kzw krb5kdc[11446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533721, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:01.986995 12055 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:22:01.988619 12055 webserver.cc:460] Webserver started at http://127.15.164.195:42423/ using document root <none> and password file <none>
I20260812 11:22:01.989328 12055 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:01.989441 12055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:01.989745 12055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:01.993083 12055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "f37ede0183714d28a79700ccec83ca19"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "c53cf1962ed273e34347199c5e551d77"
server_key_iv: "bf33df707c5aebc308cea562e5258692"
server_key_version: "encryptionkey@0"
I20260812 11:22:01.993975 12055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "f37ede0183714d28a79700ccec83ca19"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "c53cf1962ed273e34347199c5e551d77"
server_key_iv: "bf33df707c5aebc308cea562e5258692"
server_key_version: "encryptionkey@0"
I20260812 11:22:01.999771 12055 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 11:22:02.003925 12080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:02.005438 12055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:22:02.005674 12055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "f37ede0183714d28a79700ccec83ca19"
format_stamp: "Formatted at 2026-08-12 11:22:01 on dist-test-slave-7kzw"
server_key: "c53cf1962ed273e34347199c5e551d77"
server_key_iv: "bf33df707c5aebc308cea562e5258692"
server_key_version: "encryptionkey@0"
I20260812 11:22:02.005895 12055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:02.030216 12055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:02.034682 12055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:02.034981 12055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:02.035975 12055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:02.037365 12055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:02.037478 12055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:02.037633 12055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:02.037709 12055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:02.076059 12055 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:39509
I20260812 11:22:02.076028 12257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:39509 every 8 connection(s)
I20260812 11:22:02.077771 12055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:02.082785 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 12055
I20260812 11:22:02.082988 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:02.083601 16019 external_mini_cluster.cc:1428] Setting key ef16dbbc04f859c9696d33b6747f375d
Aug 12 11:22:02 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533721, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:02.102083 12262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.083540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:55345 (local address 127.15.164.254:36367)
0812 11:22:02.084559 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.084566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.085288 (+ 722us) server_negotiation.cc:407] Connection header received
0812 11:22:02.087229 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.087233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.087328 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.087419 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:02.088794 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.089597 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.091294 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.091678 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.091785 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.095360 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:02.095365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:02.095368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:02.095400 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:02.098611 (+ 3211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.099781 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.099786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.099788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.099914 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.100420 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.100425 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.100427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.100729 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:02.100867 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.101596 (+ 729us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.101800 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879,"thread_start_us":732,"threads_started":1}
I20260812 11:22:02.103068 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.084218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:36367 (local address 127.15.164.195:55345)
0812 11:22:02.085102 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.085158 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.086982 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.087579 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.087587 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.088082 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:02.088631 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.088648 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.089767 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.089771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.091129 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.091164 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.091868 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.091873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.092061 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.092755 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:02.092779 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:02.095159 (+ 2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:02.098776 (+ 3617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:02.098784 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:02.098797 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:02.099628 (+ 831us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:02.100046 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:02.100050 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:02.100053 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:02.100257 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:02.100885 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:02.100892 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:02.101242 (+ 350us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.101484 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.101858 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":354,"threads_started":1}
I20260812 11:22:02.104573 12259 heartbeater.cc:347] Connected to a master server at 127.15.164.254:36367
I20260812 11:22:02.104874 12259 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:02.105670 12259 heartbeater.cc:511] Master 127.15.164.254:36367 requested a full tablet report, sending...
I20260812 11:22:02.107146 11529 ts_manager.cc:194] Registered new tserver with Master: f37ede0183714d28a79700ccec83ca19 (127.15.164.195:39509)
I20260812 11:22:02.107937 11529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:55345
I20260812 11:22:02.112215 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:02.129915 12262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.116945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39868 (local address 127.15.164.254:36367)
0812 11:22:02.117168 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.117177 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.117615 (+ 438us) server_negotiation.cc:407] Connection header received
0812 11:22:02.117779 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.117784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.117861 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.117946 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:02.119552 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.120284 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.121580 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.122007 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.122099 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.124546 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:02.124551 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:02.124554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:02.124585 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:02.127276 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.127936 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.127941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.127943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.128068 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.128416 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.128420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.128422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.128735 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:02.128933 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.129332 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.129507 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:22:02.134341 11529 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:02.141280 11529 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:02.171438 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.155097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.15.164.193:37039)
0812 11:22:02.156396 (+ 1299us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.156405 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.157103 (+ 698us) server_negotiation.cc:407] Connection header received
0812 11:22:02.157586 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.157595 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.157871 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.158109 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:02.159472 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.161794 (+ 2322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.165911 (+ 4117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.169518 (+ 3607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.169716 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.169929 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.170840 (+ 911us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.171060 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1082,"thread_start_us":371,"threads_started":1}
I20260812 11:22:02.172019 12284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.154564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:37039 (local address 127.0.0.1:46494)
0812 11:22:02.156933 (+ 2369us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.156979 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.157297 (+ 318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.158585 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.158597 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.158646 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:02.159201 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.159221 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.162084 (+ 2863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.162093 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.165639 (+ 3546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.165663 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.170164 (+ 4501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.170173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.170508 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.170575 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.171293 (+ 718us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.171509 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2190,"thread_start_us":1776,"threads_started":1}
I20260812 11:22:02.173305 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.154568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.15.164.195:39509)
0812 11:22:02.155457 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.155469 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.158247 (+ 2778us) server_negotiation.cc:407] Connection header received
0812 11:22:02.158642 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.158650 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.158945 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.159152 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:02.160469 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.164045 (+ 3576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.169002 (+ 4957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.171449 (+ 2447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.171820 (+ 371us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.171997 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.172765 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.172935 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":489,"threads_started":1}
I20260812 11:22:02.173952 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.154137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:39509 (local address 127.0.0.1:57308)
0812 11:22:02.158081 (+ 3944us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.158114 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.158383 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.159585 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.159593 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.159626 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:02.160188 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.160203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.164297 (+ 4094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.164314 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.168740 (+ 4426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.168763 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.172186 (+ 3423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.172193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.172545 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.172578 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.173512 (+ 934us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.173637 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2359,"mutex_wait_us":71,"thread_start_us":2448,"threads_started":1}
I20260812 11:22:02.176707 11726 tablet_service.cc:1467] Processing CreateTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c (DEFAULT_TABLE table=test-table [id=466f0b6e721540c8aad83bbc548eb7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:02.177366 12155 tablet_service.cc:1467] Processing CreateTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c (DEFAULT_TABLE table=test-table [id=466f0b6e721540c8aad83bbc548eb7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:02.178412 11726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c38ea45f2f476c89eebc4b9ce1e98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:02.178763 12155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c38ea45f2f476c89eebc4b9ce1e98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:02.179388 12290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.157283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42351 (local address 127.0.0.1:50684)
0812 11:22:02.170667 (+ 13384us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.170691 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.170920 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.171858 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.171865 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.171896 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:02.172535 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.172555 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.174232 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.174239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.176362 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.176380 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.178349 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.178355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.178646 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.178680 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.178789 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.178999 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13218,"mutex_wait_us":30,"thread_start_us":12980,"threads_started":1}
I20260812 11:22:02.179409 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.157596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50684 (local address 127.15.164.194:42351)
0812 11:22:02.169849 (+ 12253us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.169859 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.170797 (+ 938us) server_negotiation.cc:407] Connection header received
0812 11:22:02.171137 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.171147 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.171408 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.171646 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:02.172734 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.174022 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.176595 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.178113 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.178305 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.178510 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.178868 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.179039 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12047,"thread_start_us":12261,"threads_started":1}
I20260812 11:22:02.183409 11954 tablet_service.cc:1467] Processing CreateTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c (DEFAULT_TABLE table=test-table [id=466f0b6e721540c8aad83bbc548eb7bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:02.184834 11954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c38ea45f2f476c89eebc4b9ce1e98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:02.191295 12292 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Bootstrap starting.
I20260812 11:22:02.193513 12294 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Bootstrap starting.
I20260812 11:22:02.197377 12292 tablet_bootstrap.cc:654] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:02.197377 12294 tablet_bootstrap.cc:654] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:02.198279 12296 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Bootstrap starting.
I20260812 11:22:02.198706 12294 log.cc:824] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:02.199371 12292 log.cc:824] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:02.201776 12294 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: No bootstrap required, opened a new log
I20260812 11:22:02.202066 12294 ts_tablet_manager.cc:1397] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 11:22:02.202077 12296 tablet_bootstrap.cc:654] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:02.202466 12292 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: No bootstrap required, opened a new log
I20260812 11:22:02.202776 12292 ts_tablet_manager.cc:1397] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260812 11:22:02.203451 12296 log.cc:824] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:02.209311 12296 tablet_bootstrap.cc:492] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: No bootstrap required, opened a new log
I20260812 11:22:02.209589 12296 ts_tablet_manager.cc:1397] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260812 11:22:02.211037 12294 raft_consensus.cc:348] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.211496 12294 raft_consensus.cc:374] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:02.211612 12294 raft_consensus.cc:729] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f37ede0183714d28a79700ccec83ca19, State: Initialized, Role: FOLLOWER
I20260812 11:22:02.212266 12294 consensus_queue.cc:260] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.213477 12259 heartbeater.cc:503] Master 127.15.164.254:36367 was elected leader, sending a full tablet report...
I20260812 11:22:02.214258 12294 ts_tablet_manager.cc:1428] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Time spent starting tablet: real 0.012s user 0.009s sys 0.005s
I20260812 11:22:02.214105 12292 raft_consensus.cc:348] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.214560 12292 raft_consensus.cc:374] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:02.214658 12292 raft_consensus.cc:729] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8144f4a8c50466cbed2294bae837f8b, State: Initialized, Role: FOLLOWER
I20260812 11:22:02.215237 12292 consensus_queue.cc:260] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.216931 12292 ts_tablet_manager.cc:1428] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20260812 11:22:02.220280 12296 raft_consensus.cc:348] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.220664 12296 raft_consensus.cc:374] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:02.220775 12296 raft_consensus.cc:729] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60da2e38f95049059161d198b31908ca, State: Initialized, Role: FOLLOWER
I20260812 11:22:02.221336 12296 consensus_queue.cc:260] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.222396 12045 heartbeater.cc:503] Master 127.15.164.254:36367 was elected leader, sending a full tablet report...
I20260812 11:22:02.222980 12296 ts_tablet_manager.cc:1428] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
W20260812 11:22:02.255828 12046 tablet.cc:2369] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:02.304292 12302 raft_consensus.cc:482] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:02.304678 12302 raft_consensus.cc:504] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.306672 12302 leader_election.cc:288] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f37ede0183714d28a79700ccec83ca19 (127.15.164.195:39509), 60da2e38f95049059161d198b31908ca (127.15.164.194:42351)
I20260812 11:22:02.314254 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.307055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:49601 (local address 127.15.164.195:39509)
0812 11:22:02.307255 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.307260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.307912 (+ 652us) server_negotiation.cc:407] Connection header received
0812 11:22:02.308173 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.308182 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.308272 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.308341 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:02.309242 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.310421 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.312318 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.313242 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.313431 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.313513 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.313829 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.313960 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:22:02.314515 12304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.307107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:39509 (local address 127.15.164.193:49601)
0812 11:22:02.307782 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.307803 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.307988 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.308570 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.308577 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.308626 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:02.309068 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.309085 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.310583 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.310589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.312154 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.312167 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.313446 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.313452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.313652 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.313689 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.313801 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.313934 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":4,"thread_start_us":351,"threads_started":1}
I20260812 11:22:02.315116 12305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.308025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42351 (local address 127.15.164.193:46963)
0812 11:22:02.309023 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:02.309044 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:02.309299 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:02.309822 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:02.309827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:02.309850 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:02.310230 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.310241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.311408 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.311413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.312976 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:02.312989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.314267 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.314274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:02.314512 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.314559 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 11:22:02.314716 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:22:02.314859 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":857,"thread_start_us":628,"threads_started":1}
I20260812 11:22:02.315176 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.308323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:46963 (local address 127.15.164.194:42351)
0812 11:22:02.308607 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.308617 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.309145 (+ 528us) server_negotiation.cc:407] Connection header received
0812 11:22:02.309479 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.309486 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.309570 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.309636 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:02.310422 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.311245 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.313135 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.314036 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.314221 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.314300 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.314770 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.314921 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 11:22:02.315712 12193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c38ea45f2f476c89eebc4b9ce1e98c" candidate_uuid: "a8144f4a8c50466cbed2294bae837f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37ede0183714d28a79700ccec83ca19" is_pre_election: true
I20260812 11:22:02.316260 12193 raft_consensus.cc:2454] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8144f4a8c50466cbed2294bae837f8b in term 0.
I20260812 11:22:02.316968 11658 leader_election.cc:302] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8144f4a8c50466cbed2294bae837f8b, f37ede0183714d28a79700ccec83ca19; no voters:
I20260812 11:22:02.317391 12302 raft_consensus.cc:2781] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:02.317574 12302 raft_consensus.cc:482] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:02.317705 12302 raft_consensus.cc:3037] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:02.317623 11982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c38ea45f2f476c89eebc4b9ce1e98c" candidate_uuid: "a8144f4a8c50466cbed2294bae837f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60da2e38f95049059161d198b31908ca" is_pre_election: true
I20260812 11:22:02.318192 11982 raft_consensus.cc:2454] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8144f4a8c50466cbed2294bae837f8b in term 0.
I20260812 11:22:02.320484 12302 raft_consensus.cc:504] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.321102 12302 leader_election.cc:288] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [CANDIDATE]: Term 1 election: Requested vote from peers f37ede0183714d28a79700ccec83ca19 (127.15.164.195:39509), 60da2e38f95049059161d198b31908ca (127.15.164.194:42351)
I20260812 11:22:02.321630 11982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c38ea45f2f476c89eebc4b9ce1e98c" candidate_uuid: "a8144f4a8c50466cbed2294bae837f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60da2e38f95049059161d198b31908ca"
I20260812 11:22:02.321645 12193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c38ea45f2f476c89eebc4b9ce1e98c" candidate_uuid: "a8144f4a8c50466cbed2294bae837f8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37ede0183714d28a79700ccec83ca19"
I20260812 11:22:02.321825 11982 raft_consensus.cc:3037] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:02.321864 12193 raft_consensus.cc:3037] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:02.324106 11982 raft_consensus.cc:2454] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8144f4a8c50466cbed2294bae837f8b in term 1.
I20260812 11:22:02.324173 12193 raft_consensus.cc:2454] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8144f4a8c50466cbed2294bae837f8b in term 1.
I20260812 11:22:02.324561 11658 leader_election.cc:302] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60da2e38f95049059161d198b31908ca, a8144f4a8c50466cbed2294bae837f8b; no voters:
I20260812 11:22:02.324885 12302 raft_consensus.cc:2781] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:02.325347 12302 raft_consensus.cc:686] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 1 LEADER]: Becoming Leader. State: Replica: a8144f4a8c50466cbed2294bae837f8b, State: Running, Role: LEADER
I20260812 11:22:02.325944 12302 consensus_queue.cc:237] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } }
I20260812 11:22:02.331197 11529 catalog_manager.cc:5495] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b reported cstate change: term changed from 0 to 1, leader changed from <none> to a8144f4a8c50466cbed2294bae837f8b (127.15.164.193). New cstate: current_term: 1 leader_uuid: "a8144f4a8c50466cbed2294bae837f8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8144f4a8c50466cbed2294bae837f8b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 37039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 } health_report { overall_health: UNKNOWN } } }
W20260812 11:22:02.331918 12260 tablet.cc:2369] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:02.358575 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.352977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.15.164.193:37039)
0812 11:22:02.353172 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.353176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.353193 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:22:02.353310 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.353314 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.353389 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.353516 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:02.353839 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.354625 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.356191 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.356862 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.356988 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.357480 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:02.358033 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:02.358163 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.358226 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.358292 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:22:02.367126 11982 raft_consensus.cc:1261] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 1 FOLLOWER]: Refusing update from remote peer a8144f4a8c50466cbed2294bae837f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:02.367146 12193 raft_consensus.cc:1261] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 1 FOLLOWER]: Refusing update from remote peer a8144f4a8c50466cbed2294bae837f8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:02.368157 12309 consensus_queue.cc:1035] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "60da2e38f95049059161d198b31908ca" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:02.368582 12302 consensus_queue.cc:1035] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37ede0183714d28a79700ccec83ca19" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:02.381698 12316 mvcc.cc:205] Tried to move back new op lower bound from 7317642126805131264 to 7317642126651047936. Current Snapshot: MvccSnapshot[applied={T|T < 7317642126805131264}]
I20260812 11:22:02.393733 11529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:02.394033 11529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:02.397696 11529 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36257ab5d73e402390c5a4503a63a077: Sending DeleteTablet for 3 replicas of tablet e0c38ea45f2f476c89eebc4b9ce1e98c
I20260812 11:22:02.398988 12155 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:02 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:57308
I20260812 11:22:02.398980 11726 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:02 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:46494
I20260812 11:22:02.399741 11954 tablet_service.cc:1514] Processing DeleteTablet for tablet e0c38ea45f2f476c89eebc4b9ce1e98c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:02 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:50684
I20260812 11:22:02.399986 12325 tablet_replica.cc:330] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: stopping tablet replica
I20260812 11:22:02.400517 12325 raft_consensus.cc:2229] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:02.401261 12325 raft_consensus.cc:2258] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:02.404006 12325 ts_tablet_manager.cc:1905] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:02.404736 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 11627
I20260812 11:22:02.414011 12325 ts_tablet_manager.cc:1918] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:02.414355 12325 log.cc:1196] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/e0c38ea45f2f476c89eebc4b9ce1e98c
I20260812 11:22:02.415156 12325 ts_tablet_manager.cc:1939] T e0c38ea45f2f476c89eebc4b9ce1e98c P f37ede0183714d28a79700ccec83ca19: Deleting consensus metadata
I20260812 11:22:02.416054 12326 tablet_replica.cc:330] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: stopping tablet replica
I20260812 11:22:02.416546 12326 raft_consensus.cc:2229] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:02.417467 11500 catalog_manager.cc:4841] TS f37ede0183714d28a79700ccec83ca19 (127.15.164.195:39509): tablet e0c38ea45f2f476c89eebc4b9ce1e98c (table test-table [id=466f0b6e721540c8aad83bbc548eb7bb]) successfully deleted
I20260812 11:22:02.417256 12326 raft_consensus.cc:2258] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:02.419430 12327 tablet_replica.cc:330] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: stopping tablet replica
I20260812 11:22:02.419888 12327 raft_consensus.cc:2229] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:02.420416 12327 raft_consensus.cc:2258] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:02.421789 12326 ts_tablet_manager.cc:1905] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:02.422544 12327 ts_tablet_manager.cc:1905] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:02.429822 12326 ts_tablet_manager.cc:1918] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:02.430029 12326 log.cc:1196] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/e0c38ea45f2f476c89eebc4b9ce1e98c
I20260812 11:22:02.430456 12327 ts_tablet_manager.cc:1918] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 12 11:22:02 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:22:02.430682 12326 ts_tablet_manager.cc:1939] T e0c38ea45f2f476c89eebc4b9ce1e98c P a8144f4a8c50466cbed2294bae837f8b: Deleting consensus metadata
I20260812 11:22:02.430650 12327 log.cc:1196] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/e0c38ea45f2f476c89eebc4b9ce1e98c
I20260812 11:22:02.431440 12327 ts_tablet_manager.cc:1939] T e0c38ea45f2f476c89eebc4b9ce1e98c P 60da2e38f95049059161d198b31908ca: Deleting consensus metadata
I20260812 11:22:02.432737 11496 catalog_manager.cc:4841] TS a8144f4a8c50466cbed2294bae837f8b (127.15.164.193:37039): tablet e0c38ea45f2f476c89eebc4b9ce1e98c (table test-table [id=466f0b6e721540c8aad83bbc548eb7bb]) successfully deleted
I20260812 11:22:02.433735 11500 catalog_manager.cc:4841] TS 60da2e38f95049059161d198b31908ca (127.15.164.194:42351): tablet e0c38ea45f2f476c89eebc4b9ce1e98c (table test-table [id=466f0b6e721540c8aad83bbc548eb7bb]) successfully deleted
I20260812 11:22:02.438889 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.407422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46516 (local address 127.15.164.193:37039)
0812 11:22:02.407873 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.407879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.419158 (+ 11279us) server_negotiation.cc:407] Connection header received
0812 11:22:02.419541 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.419547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.419666 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.419772 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:02.421951 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.423125 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.425147 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.425889 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.425986 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.432230 (+ 6244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:02.432243 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:02.432263 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:02.432318 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:02.435928 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.436655 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.436663 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.436665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.436815 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.437226 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.437231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.437234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.437621 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:02.437940 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.438271 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.438539 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315}
I20260812 11:22:02.439736 11837 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:02.539029 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 11627
I20260812 11:22:02.571834 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 11853
Aug 12 11:22:02 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:22:02.587700 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.572773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50686 (local address 127.15.164.194:42351)
0812 11:22:02.573002 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.573008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.573030 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:02.573213 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.573219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.573290 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.573406 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:02.574791 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.575631 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.576961 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.577351 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.577492 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.581890 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:02.581905 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:02.581922 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:02.581960 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:02.584711 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.585457 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.585466 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.585469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.585600 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.585988 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.585994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.585997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.586414 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:02.586799 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.587102 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.587338 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:22:02.588433 12037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:02.681455 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 11853
I20260812 11:22:02.708644 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 12055
Aug 12 11:22:02 dist-test-slave-7kzw krb5kdc[11446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:22:02.724377 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:02.709493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57320 (local address 127.15.164.195:39509)
0812 11:22:02.709685 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:02.709690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:02.709710 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:22:02.709876 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:02.709881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:02.709950 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:02.710035 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:02.711458 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.712295 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.713627 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:02.714024 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:02.714122 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:02.719006 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:02.719031 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:02.719049 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:02.719086 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:02.721818 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.722536 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.722543 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.722546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.722694 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:02.723068 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:02.723072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:02.723074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:02.723448 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:02.723678 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:02.723934 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 11:22:02.724097 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:22:02.725059 12250 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:02.816100 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 12055
I20260812 11:22:02.842788 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 11466
I20260812 11:22:02.844136 11581 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:02.956933 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 11466
2026-08-12T11:22:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4943 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T11:22:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:03Z Disabled control of system clock
I20260812 11:22:03.061578 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:42527
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:46221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:42527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:03.410835 12345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:03.411177 12345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:03.411356 12345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:03.418843 12345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:03.418952 12345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:03.419051 12345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:03.419178 12345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:03.419258 12345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:03.428767 12345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:42527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:42527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:03.430158 12345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:03.432077 12345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:03.444223 12355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:03.444288 12356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:03.444308 12358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:03.445212 12345 server_base.cc:1034] running on GCE node
I20260812 11:22:03.445989 12345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:03.447504 12345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:03.448804 12345 hybrid_clock.cc:648] HybridClock initialized: now 1786533723448757 us; error 33 us; skew 500 ppm
I20260812 11:22:03.449218 12345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:03.451712 12345 webserver.cc:460] Webserver started at http://127.15.164.254:44721/ using document root <none> and password file <none>
I20260812 11:22:03.452421 12345 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:03.452539 12345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:03.452905 12345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:03.456022 12345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "fd87d8b4dd1e4cf090e0d50492375da3"
format_stamp: "Formatted at 2026-08-12 11:22:03 on dist-test-slave-7kzw"
server_key: "6061f6d95cc7c4407bb467e3947b1a72"
server_key_iv: "fe9e1fefb2536c9dac9d87a61dcb8a78"
server_key_version: "encryptionkey@0"
I20260812 11:22:03.456881 12345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "fd87d8b4dd1e4cf090e0d50492375da3"
format_stamp: "Formatted at 2026-08-12 11:22:03 on dist-test-slave-7kzw"
server_key: "6061f6d95cc7c4407bb467e3947b1a72"
server_key_iv: "fe9e1fefb2536c9dac9d87a61dcb8a78"
server_key_version: "encryptionkey@0"
I20260812 11:22:03.462143 12345 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:22:03.465796 12367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:03.467254 12345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:22:03.467460 12345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "fd87d8b4dd1e4cf090e0d50492375da3"
format_stamp: "Formatted at 2026-08-12 11:22:03 on dist-test-slave-7kzw"
server_key: "6061f6d95cc7c4407bb467e3947b1a72"
server_key_iv: "fe9e1fefb2536c9dac9d87a61dcb8a78"
server_key_version: "encryptionkey@0"
I20260812 11:22:03.467715 12345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:03.491030 12345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:03.492048 12345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:03.492408 12345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:03.513257 12345 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:42527
I20260812 11:22:03.513278 12443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:42527 every 8 connection(s)
I20260812 11:22:03.514828 12345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:03.518916 12444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:03.520323 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 12345
I20260812 11:22:03.520512 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:03.521099 16019 external_mini_cluster.cc:1428] Setting key 4a4bdcf376edee6a519e4dc9be513058
I20260812 11:22:03.534199 12444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: Bootstrap starting.
I20260812 11:22:03.536381 12448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:03.523284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.15.164.254:42527)
0812 11:22:03.524427 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:03.524439 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:03.524494 (+ 55us) server_negotiation.cc:407] Connection header received
0812 11:22:03.526198 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:03.526221 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:03.526765 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:03.527090 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:03.527724 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:03.529154 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:03.531225 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:03.531960 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:03.532109 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:03.533457 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:03.533466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:03.533479 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:03.534341 (+ 862us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:03.534496 (+ 155us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:03.534536 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:03.534698 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:03.535082 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 11:22:03.535399 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":459,"threads_started":1}
I20260812 11:22:03.537856 12444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:03.539238 12444 log.cc:824] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:03.542568 12444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: No bootstrap required, opened a new log
I20260812 11:22:03.550748 12444 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } }
I20260812 11:22:03.551128 12444 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:03.551242 12444 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd87d8b4dd1e4cf090e0d50492375da3, State: Initialized, Role: FOLLOWER
I20260812 11:22:03.551829 12444 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } }
I20260812 11:22:03.552064 12444 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:03.552202 12444 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:03.552351 12444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:03.554580 12444 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } }
I20260812 11:22:03.555127 12444 leader_election.cc:302] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd87d8b4dd1e4cf090e0d50492375da3; no voters:
I20260812 11:22:03.555739 12444 leader_election.cc:288] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:03.555886 12452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:03.557184 12452 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [term 1 LEADER]: Becoming Leader. State: Replica: fd87d8b4dd1e4cf090e0d50492375da3, State: Running, Role: LEADER
I20260812 11:22:03.557911 12444 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:03.557787 12452 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } }
I20260812 11:22:03.560907 12455 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd87d8b4dd1e4cf090e0d50492375da3. Latest consensus state: current_term: 1 leader_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } } }
I20260812 11:22:03.561000 12454 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd87d8b4dd1e4cf090e0d50492375da3" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42527 } } }
I20260812 11:22:03.561322 12455 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:03.561426 12454 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:03.566732 12462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:03.572777 12462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:03.582010 12462 catalog_manager.cc:1347] Generated new cluster ID: f9c8f3f0408446da943c1e6225caefa2
I20260812 11:22:03.582144 12462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:03.594484 12462 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:03.595947 12462 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:03.604008 12462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: Generated new TSK 0
I20260812 11:22:03.604995 12462 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:03.615458 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--builtin_ntp_servers=127.15.164.212:46221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:03.981647 12481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:03.981972 12481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:03.982141 12481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:03.989317 12481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:03.989457 12481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:03.989637 12481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:03.998682 12481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:04.000039 12481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:04.001932 12481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:04.015681 12489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.015741 12488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.015766 12491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:04.017215 12481 server_base.cc:1034] running on GCE node
I20260812 11:22:04.017889 12481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:04.018903 12481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:04.020183 12481 hybrid_clock.cc:648] HybridClock initialized: now 1786533724020119 us; error 59 us; skew 500 ppm
I20260812 11:22:04.020545 12481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:04.022888 12481 webserver.cc:460] Webserver started at http://127.15.164.193:34861/ using document root <none> and password file <none>
I20260812 11:22:04.023618 12481 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:04.023761 12481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:04.024093 12481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:04.027029 12481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "f502a378e02e40ba90701924a4b0f8e8"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "f6dd199ea5fb14b0e7d26ccb63d60709"
server_key_iv: "aad4bc40f00aaa4ed2903d4e8aa8bb9d"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.027863 12481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "f502a378e02e40ba90701924a4b0f8e8"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "f6dd199ea5fb14b0e7d26ccb63d60709"
server_key_iv: "aad4bc40f00aaa4ed2903d4e8aa8bb9d"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.033034 12481 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:22:04.037035 12498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.038443 12481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:04.038724 12481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "f502a378e02e40ba90701924a4b0f8e8"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "f6dd199ea5fb14b0e7d26ccb63d60709"
server_key_iv: "aad4bc40f00aaa4ed2903d4e8aa8bb9d"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.038966 12481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:04.058248 12481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:04.059260 12481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:04.059607 12481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:04.060698 12481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:04.062260 12481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:04.062409 12481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.062585 12481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:04.062690 12481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.100255 12481 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:35619
I20260812 11:22:04.100315 12684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:35619 every 8 connection(s)
I20260812 11:22:04.101697 12481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:04.109942 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 12481
I20260812 11:22:04.110116 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:04.110673 16019 external_mini_cluster.cc:1428] Setting key dcf733b48fd13e9acdf846e149fc2d23
I20260812 11:22:04.113842 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--builtin_ntp_servers=127.15.164.212:46221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:04.115846 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:04.104495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:49093 (local address 127.15.164.254:42527)
0812 11:22:04.104948 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:04.104953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:04.106081 (+ 1128us) server_negotiation.cc:407] Connection header received
0812 11:22:04.107990 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:04.107996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:04.108095 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:04.108219 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:04.109289 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.110318 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.112633 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.113208 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.113357 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:04.114804 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:04.114813 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:04.114820 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:04.114846 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:04.114901 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:04.114922 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:04.115023 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:04.115279 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 11:22:04.115392 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":266,"threads_started":1}
I20260812 11:22:04.116508 12688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:04.105028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42527 (local address 127.15.164.193:49093)
0812 11:22:04.105929 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:04.105965 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:04.107707 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:04.108449 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:04.108456 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:04.108545 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:04.109105 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:04.109122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.110570 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.110575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:04.112480 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:04.112500 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.113453 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.113458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:04.113658 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:04.114410 (+ 752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:04.114413 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:04.114456 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:04.114602 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:04.115033 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:04.115042 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:04.115048 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:22:04.115203 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:22:04.115477 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":270,"threads_started":1}
I20260812 11:22:04.117995 12685 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42527
I20260812 11:22:04.118333 12685 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:04.119308 12685 heartbeater.cc:511] Master 127.15.164.254:42527 requested a full tablet report, sending...
I20260812 11:22:04.121546 12392 ts_manager.cc:194] Registered new tserver with Master: f502a378e02e40ba90701924a4b0f8e8 (127.15.164.193:35619)
I20260812 11:22:04.123119 12392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.193:49093
W20260812 11:22:04.466962 12689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:04.467257 12689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:04.467481 12689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:04.474957 12689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:04.475056 12689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:04.475272 12689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:04.484352 12689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:04.485785 12689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:04.487835 12689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:04.501933 12698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.501901 12702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.502091 12697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:04.502614 12689 server_base.cc:1034] running on GCE node
I20260812 11:22:04.503520 12689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:04.504514 12689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:04.505779 12689 hybrid_clock.cc:648] HybridClock initialized: now 1786533724505721 us; error 55 us; skew 500 ppm
I20260812 11:22:04.506145 12689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:04.508752 12689 webserver.cc:460] Webserver started at http://127.15.164.194:42215/ using document root <none> and password file <none>
I20260812 11:22:04.509491 12689 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:04.509640 12689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:04.509970 12689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:04.513062 12689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "08a1624eaa6840e292cb36beee1b1025"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "b4e9ef2e4c54a51dc943321236d46ef3"
server_key_iv: "b962cc67d590f8e64d79950ec45cc7de"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.513891 12689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "08a1624eaa6840e292cb36beee1b1025"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "b4e9ef2e4c54a51dc943321236d46ef3"
server_key_iv: "b962cc67d590f8e64d79950ec45cc7de"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.519213 12689 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:22:04.523197 12711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.524703 12689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:04.524904 12689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "08a1624eaa6840e292cb36beee1b1025"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "b4e9ef2e4c54a51dc943321236d46ef3"
server_key_iv: "b962cc67d590f8e64d79950ec45cc7de"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.525146 12689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:04.543370 12689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:04.544330 12689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:04.544653 12689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:04.545652 12689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:04.547426 12689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:04.547569 12689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.547698 12689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:04.547796 12689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.583374 12689 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:42447
I20260812 11:22:04.583431 12882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:42447 every 8 connection(s)
I20260812 11:22:04.584882 12689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:04.585139 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 12689
I20260812 11:22:04.585325 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:04.586042 16019 external_mini_cluster.cc:1428] Setting key 9ec3c504667e8f37e36918381cfe44d9
I20260812 11:22:04.589743 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--builtin_ntp_servers=127.15.164.212:46221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:04.601056 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:04.587981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:56079 (local address 127.15.164.254:42527)
0812 11:22:04.588170 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:04.588174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:04.589909 (+ 1735us) server_negotiation.cc:407] Connection header received
0812 11:22:04.592818 (+ 2909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:04.592823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:04.592898 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:04.593001 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:04.594459 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.595347 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.597932 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.598412 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.598625 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:04.600317 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:04.600322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:04.600325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:04.600344 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:04.600378 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:04.600390 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:04.600471 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:04.600737 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 11:22:04.600821 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:22:04.602661 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:04.588577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42527 (local address 127.15.164.194:56079)
0812 11:22:04.589717 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:04.589781 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:04.592500 (+ 2719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:04.593286 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:04.593299 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:04.593420 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:04.594241 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:04.594280 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.595514 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.595523 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:04.597755 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:04.597775 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:04.598722 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:04.598732 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:04.599061 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:04.599906 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:04.599912 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:04.599968 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:04.600072 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:04.600498 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:04.600513 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:04.600523 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:22:04.600720 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 11:22:04.601179 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":334,"threads_started":1}
I20260812 11:22:04.604208 12883 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42527
I20260812 11:22:04.604574 12883 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:04.605474 12883 heartbeater.cc:511] Master 127.15.164.254:42527 requested a full tablet report, sending...
I20260812 11:22:04.607208 12392 ts_manager.cc:194] Registered new tserver with Master: 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447)
I20260812 11:22:04.608144 12392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.194:56079
W20260812 11:22:04.940654 12886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:04.941007 12886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:04.941200 12886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:04.948884 12886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:04.949087 12886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:04.949281 12886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:04.958561 12886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:46221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:04.959909 12886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:04.961802 12886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:04.975236 12894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.975349 12896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:04.975378 12893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:04.976501 12886 server_base.cc:1034] running on GCE node
I20260812 11:22:04.977152 12886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:04.978135 12886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:04.979367 12886 hybrid_clock.cc:648] HybridClock initialized: now 1786533724979319 us; error 55 us; skew 500 ppm
I20260812 11:22:04.979701 12886 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:04.981940 12886 webserver.cc:460] Webserver started at http://127.15.164.195:40029/ using document root <none> and password file <none>
I20260812 11:22:04.982722 12886 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:04.982870 12886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:04.983191 12886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:04.986022 12886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "eb77869f73c20cea39a729326e8e3ac1"
server_key_iv: "5976cc8fce231d01f2e5ef007014436b"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.986874 12886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "eb77869f73c20cea39a729326e8e3ac1"
server_key_iv: "5976cc8fce231d01f2e5ef007014436b"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.992014 12886 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 11:22:04.995527 12906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:04.996858 12886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:22:04.997056 12886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f"
format_stamp: "Formatted at 2026-08-12 11:22:04 on dist-test-slave-7kzw"
server_key: "eb77869f73c20cea39a729326e8e3ac1"
server_key_iv: "5976cc8fce231d01f2e5ef007014436b"
server_key_version: "encryptionkey@0"
I20260812 11:22:04.997275 12886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:05.014102 12886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:05.015012 12886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:05.015326 12886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:05.016350 12886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:05.017836 12886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:05.017956 12886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:05.018090 12886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:05.018188 12886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:05.052909 12886 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:38271
I20260812 11:22:05.052947 13079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:38271 every 8 connection(s)
I20260812 11:22:05.054262 12886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:05.063179 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 12886
I20260812 11:22:05.063382 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:05.063853 16019 external_mini_cluster.cc:1428] Setting key c15dacb559e826c0138d031844a410eb
I20260812 11:22:05.067341 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.056993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:48955 (local address 127.15.164.254:42527)
0812 11:22:05.057269 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.057276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.058721 (+ 1445us) server_negotiation.cc:407] Connection header received
0812 11:22:05.060567 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.060571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.060640 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.060730 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:05.061730 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.062526 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.064160 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.064699 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.064834 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.066379 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:05.066386 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:05.066390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:05.066416 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:05.066449 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:05.066510 (+ 61us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:05.066606 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.066851 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.066950 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:22:05.068305 13083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.057530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42527 (local address 127.15.164.195:48955)
0812 11:22:05.058570 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.058619 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.060328 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.060931 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.060939 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.061016 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:05.061580 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.061596 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.062669 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.062673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.064013 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.064027 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.064958 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.064965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.065291 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.066063 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:05.066066 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:05.066104 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:05.066174 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:05.066609 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:05.066620 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:05.066629 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.066836 (+ 207us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.067206 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":289,"threads_started":1}
I20260812 11:22:05.069612 13080 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42527
I20260812 11:22:05.069869 13080 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:05.070662 13080 heartbeater.cc:511] Master 127.15.164.254:42527 requested a full tablet report, sending...
I20260812 11:22:05.072124 12392 ts_manager.cc:194] Registered new tserver with Master: 63d70f461b2a4af2b03b2c9bc3fcc87f (127.15.164.195:38271)
I20260812 11:22:05.073199 12392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.195:48955
I20260812 11:22:05.079305 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:05.089032 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.083429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40762 (local address 127.15.164.254:42527)
0812 11:22:05.083617 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.083622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.084101 (+ 479us) server_negotiation.cc:407] Connection header received
0812 11:22:05.084240 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.084244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.084317 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.084403 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:05.084872 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.085557 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.086982 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.087393 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.087492 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.088473 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:05.088477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:05.088480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:05.088497 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:05.088529 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:05.088541 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:05.088613 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.088742 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.088813 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:22:05.092567 12392 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:05.099598 12392 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:05.125061 13096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.112145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:35619 (local address 127.0.0.1:46310)
0812 11:22:05.114006 (+ 1861us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.114067 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.114280 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.117789 (+ 3509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.117803 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.117838 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.118429 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.118453 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.120431 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.120436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.122376 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.122389 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.124060 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.124067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.124283 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.124343 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.124451 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.124637 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1544,"mutex_wait_us":96,"thread_start_us":1369,"threads_started":1}
I20260812 11:22:05.125695 13099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.112749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38271 (local address 127.0.0.1:34276)
0812 11:22:05.116907 (+ 4158us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.116929 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.117054 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.117915 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.117922 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.117961 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.118545 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.118559 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.120606 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.120611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.123016 (+ 2405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.123032 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.124877 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.124884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.125057 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.125089 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.125226 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.125339 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4003,"mutex_wait_us":40,"thread_start_us":3840,"threads_started":1}
I20260812 11:22:05.125856 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.112985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34276 (local address 127.15.164.195:38271)
0812 11:22:05.115125 (+ 2140us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.115137 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.117182 (+ 2045us) server_negotiation.cc:407] Connection header received
0812 11:22:05.117294 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.117302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.117537 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.117739 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.118734 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.120472 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.123251 (+ 2779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.124658 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.124870 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.125099 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.125299 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.125478 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1907,"thread_start_us":1710,"threads_started":1}
I20260812 11:22:05.126452 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.112252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46310 (local address 127.15.164.193:35619)
0812 11:22:05.117207 (+ 4955us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.117215 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.117238 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:22:05.117315 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.117320 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.117536 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.118367 (+ 831us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.118637 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.120280 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.122600 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.123844 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.125649 (+ 1805us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.125878 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.125949 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.126122 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4732,"thread_start_us":4631,"threads_started":1}
I20260812 11:22:05.126788 13102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.114976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47756 (local address 127.15.164.194:42447)
0812 11:22:05.117502 (+ 2526us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.117514 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.118288 (+ 774us) server_negotiation.cc:407] Connection header received
0812 11:22:05.118402 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.118411 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.118681 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.118886 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.119536 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.120982 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.123492 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.124723 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.124910 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.125119 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.126263 (+ 1144us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.126414 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2344,"thread_start_us":2224,"threads_started":1}
I20260812 11:22:05.126973 13101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.114405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42447 (local address 127.0.0.1:47756)
0812 11:22:05.117927 (+ 3522us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.117942 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.118068 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.118874 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.118878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.118905 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.119318 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.119335 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.121135 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.121141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.123272 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.123286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.125498 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.125505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.126065 (+ 560us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.126110 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.126215 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.126331 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3400,"mutex_wait_us":1,"thread_start_us":3266,"threads_started":1}
I20260812 11:22:05.127672 12685 heartbeater.cc:503] Master 127.15.164.254:42527 was elected leader, sending a full tablet report...
I20260812 11:22:05.130218 12579 tablet_service.cc:1467] Processing CreateTablet for tablet b8b599d18ed3452eab8da14af4178e09 (DEFAULT_TABLE table=test-table [id=9fd4905add4f42d08661a8152a4cddd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:05.130201 12980 tablet_service.cc:1467] Processing CreateTablet for tablet b8b599d18ed3452eab8da14af4178e09 (DEFAULT_TABLE table=test-table [id=9fd4905add4f42d08661a8152a4cddd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:05.130550 12782 tablet_service.cc:1467] Processing CreateTablet for tablet b8b599d18ed3452eab8da14af4178e09 (DEFAULT_TABLE table=test-table [id=9fd4905add4f42d08661a8152a4cddd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:05.131686 12980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8b599d18ed3452eab8da14af4178e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:05.131768 12579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8b599d18ed3452eab8da14af4178e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:05.131783 12782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8b599d18ed3452eab8da14af4178e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:05.144778 13103 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Bootstrap starting.
I20260812 11:22:05.146266 13104 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Bootstrap starting.
I20260812 11:22:05.147184 13105 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Bootstrap starting.
I20260812 11:22:05.148983 13103 tablet_bootstrap.cc:654] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:05.150305 13103 log.cc:824] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:05.150928 13104 tablet_bootstrap.cc:654] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:05.152091 13105 tablet_bootstrap.cc:654] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:05.152164 13104 log.cc:824] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:05.153282 13105 log.cc:824] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:05.154058 13103 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: No bootstrap required, opened a new log
I20260812 11:22:05.154341 13103 ts_tablet_manager.cc:1397] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:22:05.155577 13104 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: No bootstrap required, opened a new log
I20260812 11:22:05.155844 13104 ts_tablet_manager.cc:1397] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:22:05.157871 13105 tablet_bootstrap.cc:492] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: No bootstrap required, opened a new log
I20260812 11:22:05.158141 13105 ts_tablet_manager.cc:1397] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260812 11:22:05.162094 13103 raft_consensus.cc:348] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.162478 13103 raft_consensus.cc:374] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:05.162628 13103 raft_consensus.cc:729] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63d70f461b2a4af2b03b2c9bc3fcc87f, State: Initialized, Role: FOLLOWER
I20260812 11:22:05.163335 13103 consensus_queue.cc:260] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.164997 13080 heartbeater.cc:503] Master 127.15.164.254:42527 was elected leader, sending a full tablet report...
I20260812 11:22:05.165556 13103 ts_tablet_manager.cc:1428] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260812 11:22:05.166366 13104 raft_consensus.cc:348] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.166841 13104 raft_consensus.cc:374] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:05.166939 13104 raft_consensus.cc:729] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a1624eaa6840e292cb36beee1b1025, State: Initialized, Role: FOLLOWER
I20260812 11:22:05.167616 13104 consensus_queue.cc:260] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.168840 12883 heartbeater.cc:503] Master 127.15.164.254:42527 was elected leader, sending a full tablet report...
I20260812 11:22:05.169660 13105 raft_consensus.cc:348] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.169996 13105 raft_consensus.cc:374] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:05.170102 13105 raft_consensus.cc:729] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f502a378e02e40ba90701924a4b0f8e8, State: Initialized, Role: FOLLOWER
I20260812 11:22:05.170274 13104 ts_tablet_manager.cc:1428] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260812 11:22:05.170756 13105 consensus_queue.cc:260] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.172441 13105 ts_tablet_manager.cc:1428] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260812 11:22:05.306074 13081 tablet.cc:2369] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:05.337319 12884 tablet.cc:2369] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:05.354523 12686 tablet.cc:2369] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:05.409742 13112 raft_consensus.cc:482] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:05.410081 13112 raft_consensus.cc:504] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.412019 13112 leader_election.cc:288] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447), 63d70f461b2a4af2b03b2c9bc3fcc87f (127.15.164.195:38271)
I20260812 11:22:05.416285 13110 raft_consensus.cc:482] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:05.416640 13110 raft_consensus.cc:504] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.418633 13110 leader_election.cc:288] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f502a378e02e40ba90701924a4b0f8e8 (127.15.164.193:35619), 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447)
I20260812 11:22:05.420584 13102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.412544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41483 (local address 127.15.164.194:42447)
0812 11:22:05.412816 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.412825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.413436 (+ 611us) server_negotiation.cc:407] Connection header received
0812 11:22:05.413642 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.413648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.413751 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.413843 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.414672 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.415421 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.418126 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.419354 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.419488 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.419549 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.420098 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.420243 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:22:05.421439 13113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.412158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42447 (local address 127.15.164.193:41483)
0812 11:22:05.413289 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.413314 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.413483 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.413903 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.413908 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.413938 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.414444 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.414457 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.415563 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.415569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.417912 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.417928 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.419676 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.419685 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.419883 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.419916 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.420847 (+ 931us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.421040 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":153,"thread_start_us":714,"threads_started":1}
I20260812 11:22:05.421792 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.412627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:58375 (local address 127.15.164.195:38271)
0812 11:22:05.413004 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.413010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.413639 (+ 629us) server_negotiation.cc:407] Connection header received
0812 11:22:05.413894 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.413899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.413978 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.414096 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.414852 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.415673 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.417896 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.419204 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.419370 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.419458 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.421378 (+ 1920us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.421547 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260812 11:22:05.422868 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.412648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38271 (local address 127.15.164.193:58375)
0812 11:22:05.413484 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.413509 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.413658 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.414124 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.414127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.414151 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.414621 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.414636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.415831 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.415835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.417648 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.417661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.420974 (+ 3313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.420980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.421154 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.421189 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.422336 (+ 1147us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.422525 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":25,"thread_start_us":504,"threads_started":1}
I20260812 11:22:05.422717 12816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "f502a378e02e40ba90701924a4b0f8e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a1624eaa6840e292cb36beee1b1025" is_pre_election: true
I20260812 11:22:05.423425 12816 raft_consensus.cc:2454] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f502a378e02e40ba90701924a4b0f8e8 in term 0.
I20260812 11:22:05.424273 12500 leader_election.cc:302] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a1624eaa6840e292cb36beee1b1025, f502a378e02e40ba90701924a4b0f8e8; no voters:
I20260812 11:22:05.424187 13009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "f502a378e02e40ba90701924a4b0f8e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" is_pre_election: true
I20260812 11:22:05.424738 13009 raft_consensus.cc:2454] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f502a378e02e40ba90701924a4b0f8e8 in term 0.
I20260812 11:22:05.425242 13112 raft_consensus.cc:2781] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:05.425410 13112 raft_consensus.cc:482] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:05.425523 13112 raft_consensus.cc:3037] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:05.426772 13083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.418771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:35619 (local address 127.15.164.195:58891)
0812 11:22:05.419608 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.419631 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.419753 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.420278 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.420283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.420313 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.420543 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.420553 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.422089 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.422094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.424266 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.424284 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.425965 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.425971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.426165 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.426200 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.426305 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.426451 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":24}
I20260812 11:22:05.426803 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.419111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:58891 (local address 127.15.164.193:35619)
0812 11:22:05.419313 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.419320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.419701 (+ 381us) server_negotiation.cc:407] Connection header received
0812 11:22:05.419905 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.419910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.420010 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.420092 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.420725 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.421906 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.424477 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.425790 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.425974 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.426066 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.426356 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.426531 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":75}
I20260812 11:22:05.427937 12617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f502a378e02e40ba90701924a4b0f8e8" is_pre_election: true
I20260812 11:22:05.428613 13116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.419155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:42447 (local address 127.15.164.195:35041)
0812 11:22:05.419867 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:05.419890 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:05.420027 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:05.421037 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:05.421044 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:05.421076 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:05.421478 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.421489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.423490 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.423495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.425826 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:05.425843 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.427812 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.427820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:05.428005 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.428044 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:22:05.428149 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:22:05.428284 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":1,"thread_start_us":609,"threads_started":1}
I20260812 11:22:05.428751 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.419563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:35041 (local address 127.15.164.194:42447)
0812 11:22:05.420699 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.420704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.420726 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:05.420785 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.420791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.420876 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.421654 (+ 778us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:05.421993 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.423288 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.426198 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.427634 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.427845 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.427921 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.428210 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.428389 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":740,"threads_started":1}
I20260812 11:22:05.429441 12816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a1624eaa6840e292cb36beee1b1025" is_pre_election: true
I20260812 11:22:05.429504 13112 raft_consensus.cc:504] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.429710 12816 raft_consensus.cc:2454] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63d70f461b2a4af2b03b2c9bc3fcc87f in term 0.
I20260812 11:22:05.429988 12617 raft_consensus.cc:2379] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63d70f461b2a4af2b03b2c9bc3fcc87f in current term 1: Already voted for candidate f502a378e02e40ba90701924a4b0f8e8 in this term.
I20260812 11:22:05.430322 12907 leader_election.cc:302] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a1624eaa6840e292cb36beee1b1025, 63d70f461b2a4af2b03b2c9bc3fcc87f; no voters:
I20260812 11:22:05.430733 12816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "f502a378e02e40ba90701924a4b0f8e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a1624eaa6840e292cb36beee1b1025"
I20260812 11:22:05.430733 13009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "f502a378e02e40ba90701924a4b0f8e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f"
I20260812 11:22:05.430876 13110 raft_consensus.cc:2781] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:05.430927 12816 raft_consensus.cc:3037] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:05.431041 13110 raft_consensus.cc:482] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:05.431147 13110 raft_consensus.cc:3037] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:05.431214 13112 leader_election.cc:288] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [CANDIDATE]: Term 1 election: Requested vote from peers 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447), 63d70f461b2a4af2b03b2c9bc3fcc87f (127.15.164.195:38271)
I20260812 11:22:05.433490 12816 raft_consensus.cc:2454] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f502a378e02e40ba90701924a4b0f8e8 in term 1.
I20260812 11:22:05.433815 13110 raft_consensus.cc:504] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.433878 12500 leader_election.cc:302] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a1624eaa6840e292cb36beee1b1025, f502a378e02e40ba90701924a4b0f8e8; no voters:
I20260812 11:22:05.434252 13009 raft_consensus.cc:2379] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f502a378e02e40ba90701924a4b0f8e8 in current term 1: Already voted for candidate 63d70f461b2a4af2b03b2c9bc3fcc87f in this term.
I20260812 11:22:05.434247 13112 raft_consensus.cc:2781] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:05.434672 13110 leader_election.cc:288] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [CANDIDATE]: Term 1 election: Requested vote from peers f502a378e02e40ba90701924a4b0f8e8 (127.15.164.193:35619), 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447)
I20260812 11:22:05.435225 12816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a1624eaa6840e292cb36beee1b1025"
I20260812 11:22:05.435310 12617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8b599d18ed3452eab8da14af4178e09" candidate_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f502a378e02e40ba90701924a4b0f8e8"
I20260812 11:22:05.435597 12816 raft_consensus.cc:2379] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63d70f461b2a4af2b03b2c9bc3fcc87f in current term 1: Already voted for candidate f502a378e02e40ba90701924a4b0f8e8 in this term.
I20260812 11:22:05.436290 13112 raft_consensus.cc:686] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 LEADER]: Becoming Leader. State: Replica: f502a378e02e40ba90701924a4b0f8e8, State: Running, Role: LEADER
I20260812 11:22:05.436785 13112 consensus_queue.cc:237] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } }
I20260812 11:22:05.439967 12907 leader_election.cc:302] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63d70f461b2a4af2b03b2c9bc3fcc87f; no voters: 08a1624eaa6840e292cb36beee1b1025, f502a378e02e40ba90701924a4b0f8e8
I20260812 11:22:05.440282 13110 raft_consensus.cc:2726] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 11:22:05.441468 12392 catalog_manager.cc:5495] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f502a378e02e40ba90701924a4b0f8e8 (127.15.164.193). New cstate: current_term: 1 leader_uuid: "f502a378e02e40ba90701924a4b0f8e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f502a378e02e40ba90701924a4b0f8e8" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260812 11:22:05.492700 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.487196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46322 (local address 127.15.164.193:35619)
0812 11:22:05.487397 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.487402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.487421 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:22:05.487521 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.487525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.487620 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.487761 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:05.488093 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.488956 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.490367 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.490830 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.490934 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.491416 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:05.491959 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:05.492112 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.492349 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.492418 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:22:05.500975 13009 raft_consensus.cc:1261] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Refusing update from remote peer f502a378e02e40ba90701924a4b0f8e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:05.501065 12816 raft_consensus.cc:1261] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 1 FOLLOWER]: Refusing update from remote peer f502a378e02e40ba90701924a4b0f8e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:05.502004 13119 consensus_queue.cc:1035] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63d70f461b2a4af2b03b2c9bc3fcc87f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:05.502481 13112 consensus_queue.cc:1035] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a1624eaa6840e292cb36beee1b1025" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:05.512964 13122 mvcc.cc:205] Tried to move back new op lower bound from 7317642139641987072 to 7317642139392802816. Current Snapshot: MvccSnapshot[applied={T|T < 7317642139641987072}]
I20260812 11:22:05.522324 13123 mvcc.cc:205] Tried to move back new op lower bound from 7317642139641987072 to 7317642139392802816. Current Snapshot: MvccSnapshot[applied={T|T < 7317642139641987072}]
I20260812 11:22:05.539335 12391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:05.539649 12391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:05.543447 12391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd87d8b4dd1e4cf090e0d50492375da3: Sending DeleteTablet for 3 replicas of tablet b8b599d18ed3452eab8da14af4178e09
I20260812 11:22:05.544731 12980 tablet_service.cc:1514] Processing DeleteTablet for tablet b8b599d18ed3452eab8da14af4178e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:05 UTC) from {username='slave'} at 127.0.0.1:34276
I20260812 11:22:05.544780 12782 tablet_service.cc:1514] Processing DeleteTablet for tablet b8b599d18ed3452eab8da14af4178e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:05 UTC) from {username='slave'} at 127.0.0.1:47756
I20260812 11:22:05.545495 12579 tablet_service.cc:1514] Processing DeleteTablet for tablet b8b599d18ed3452eab8da14af4178e09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:05 UTC) from {username='slave'} at 127.0.0.1:46310
I20260812 11:22:05.545622 13134 tablet_replica.cc:330] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: stopping tablet replica
I20260812 11:22:05.546041 13134 raft_consensus.cc:2229] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:05.546504 13139 tablet_replica.cc:330] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: stopping tablet replica
I20260812 11:22:05.546614 13134 raft_consensus.cc:2258] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:05.547052 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 12481
I20260812 11:22:05.547017 13139 raft_consensus.cc:2229] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:05.547438 13135 tablet_replica.cc:330] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: stopping tablet replica
I20260812 11:22:05.547847 13135 raft_consensus.cc:2229] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:05.547936 13139 raft_consensus.cc:2258] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:05.548311 13135 raft_consensus.cc:2258] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:05.550477 13135 ts_tablet_manager.cc:1905] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:05.551594 13139 ts_tablet_manager.cc:1905] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:05.555660 13134 ts_tablet_manager.cc:1905] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:05.559522 13139 ts_tablet_manager.cc:1918] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:05.559768 13139 log.cc:1196] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/b8b599d18ed3452eab8da14af4178e09
I20260812 11:22:05.560467 13139 ts_tablet_manager.cc:1939] T b8b599d18ed3452eab8da14af4178e09 P f502a378e02e40ba90701924a4b0f8e8: Deleting consensus metadata
I20260812 11:22:05.562458 12371 catalog_manager.cc:4841] TS f502a378e02e40ba90701924a4b0f8e8 (127.15.164.193:35619): tablet b8b599d18ed3452eab8da14af4178e09 (table test-table [id=9fd4905add4f42d08661a8152a4cddd6]) successfully deleted
I20260812 11:22:05.562624 13134 ts_tablet_manager.cc:1918] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:05.562778 13134 log.cc:1196] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/b8b599d18ed3452eab8da14af4178e09
I20260812 11:22:05.563241 13134 ts_tablet_manager.cc:1939] T b8b599d18ed3452eab8da14af4178e09 P 63d70f461b2a4af2b03b2c9bc3fcc87f: Deleting consensus metadata
I20260812 11:22:05.564754 12374 catalog_manager.cc:4841] TS 63d70f461b2a4af2b03b2c9bc3fcc87f (127.15.164.195:38271): tablet b8b599d18ed3452eab8da14af4178e09 (table test-table [id=9fd4905add4f42d08661a8152a4cddd6]) successfully deleted
I20260812 11:22:05.568176 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.550260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46330 (local address 127.15.164.193:35619)
0812 11:22:05.550484 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.550492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.559171 (+ 8679us) server_negotiation.cc:407] Connection header received
0812 11:22:05.559729 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.559736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.559879 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.559966 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:05.560739 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.562065 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.564426 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.565107 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.565264 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.566448 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:05.566458 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:05.566506 (+ 48us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:05.567309 (+ 803us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:05.567407 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:05.567434 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:05.567571 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.567740 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.567842 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:22:05.568270 13135 ts_tablet_manager.cc:1918] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:05.568470 13135 log.cc:1196] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/b8b599d18ed3452eab8da14af4178e09
I20260812 11:22:05.568938 12678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:05.569080 13135 ts_tablet_manager.cc:1939] T b8b599d18ed3452eab8da14af4178e09 P 08a1624eaa6840e292cb36beee1b1025: Deleting consensus metadata
I20260812 11:22:05.571131 12371 catalog_manager.cc:4841] TS 08a1624eaa6840e292cb36beee1b1025 (127.15.164.194:42447): tablet b8b599d18ed3452eab8da14af4178e09 (table test-table [id=9fd4905add4f42d08661a8152a4cddd6]) successfully deleted
I20260812 11:22:05.698181 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 12481
I20260812 11:22:05.729164 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 12689
I20260812 11:22:05.736701 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.730104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47768 (local address 127.15.164.194:42447)
0812 11:22:05.730290 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.730295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.730314 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:22:05.730565 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.730571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.730667 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.730760 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:05.731144 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.731833 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.733207 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.733643 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.733742 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.735068 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:05.735079 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:05.735095 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:05.735775 (+ 680us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:05.735829 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:05.735852 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:05.735951 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.736174 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.736320 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:22:05.737442 12876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:05.828889 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 12689
I20260812 11:22:05.859634 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 12886
I20260812 11:22:05.867445 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:05.860570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.15.164.195:38271)
0812 11:22:05.860789 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:05.860794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:05.860814 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:22:05.861033 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:05.861038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:05.861144 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:05.861249 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:05.861681 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.862569 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.864122 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:05.864611 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:05.864761 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:05.865951 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:05.865961 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:05.865979 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:05.866680 (+ 701us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:05.866733 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:05.866775 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:05.866873 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:05.867050 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 11:22:05.867162 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:22:05.868186 13073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:05.960942 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 12886
I20260812 11:22:05.989423 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 12345
I20260812 11:22:05.990679 12438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:06.100425 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 12345
2026-08-12T11:22:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3142 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:06 dist-test-slave-7kzw krb5kdc[13156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:06 dist-test-slave-7kzw krb5kdc[13156](info): set up 2 sockets
Aug 12 11:22:06 dist-test-slave-7kzw krb5kdc[13156](info): commencing operation
krb5kdc: starting...
W20260812 11:22:07.478093 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:07 dist-test-slave-7kzw krb5kdc[13156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:07.789623 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:42103
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:42103
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:08.140772 13174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:08.141058 13174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:08.141238 13174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:08.148609 13174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:08.148717 13174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:08.148821 13174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:08.148921 13174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:08.149006 13174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:08.158739 13174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:42103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:42103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:08.160095 13174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:08.161461 13174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:08.174415 13186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:08.174520 13187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:08.174479 13190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:08.175431 13174 server_base.cc:1034] running on GCE node
I20260812 11:22:08.176270 13174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:08.177775 13174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:08.179019 13174 hybrid_clock.cc:648] HybridClock initialized: now 1786533728178954 us; error 53 us; skew 500 ppm
I20260812 11:22:08.179406 13174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:08 dist-test-slave-7kzw krb5kdc[13156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533728, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:08.188220 13174 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:08.190003 13174 webserver.cc:460] Webserver started at http://127.15.164.254:40393/ using document root <none> and password file <none>
I20260812 11:22:08.190842 13174 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:08.190997 13174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:08.191331 13174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:08.194456 13174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "308d5b3540e84705936010784ad4c10d"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "3e3d57008ee0d0464317f4f697c76f4f"
server_key_iv: "c84fdccdba8159c254475ff5bf645163"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.195356 13174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "308d5b3540e84705936010784ad4c10d"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "3e3d57008ee0d0464317f4f697c76f4f"
server_key_iv: "c84fdccdba8159c254475ff5bf645163"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.200794 13174 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:08.204414 13200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:08.205755 13174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:22:08.205958 13174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "308d5b3540e84705936010784ad4c10d"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "3e3d57008ee0d0464317f4f697c76f4f"
server_key_iv: "c84fdccdba8159c254475ff5bf645163"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.206173 13174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:08.228330 13174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:08.233023 13174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:08.233340 13174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:08.251770 13174 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:42103
I20260812 11:22:08.251782 13274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:42103 every 8 connection(s)
I20260812 11:22:08.253214 13174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:08.257097 13275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:08.260090 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 13174
I20260812 11:22:08.260288 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:08.260764 16019 external_mini_cluster.cc:1428] Setting key 14177d2aa4cafa6c693ddedcbded4565
I20260812 11:22:08.270319 13275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: Bootstrap starting.
I20260812 11:22:08.273916 13275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:08.275388 13275 log.cc:824] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:22:08 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:08.278689 13275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: No bootstrap required, opened a new log
I20260812 11:22:08.287781 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:08.262805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36896 (local address 127.15.164.254:42103)
0812 11:22:08.263572 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:08.263587 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:08.263638 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:22:08.266004 (+ 2366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:08.266035 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:08.266585 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:08.267034 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:08.268485 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.270515 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.271944 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.272993 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.273183 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:08.278574 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:08.278585 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:08.278605 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:08.278659 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:08.282916 (+ 4257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:08.283608 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:08.283619 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:08.283632 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:08.283886 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:08.284352 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:08.284358 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:08.284361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:08.285100 (+ 739us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:08.285422 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:08.285834 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 11:22:08.286307 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":301,"threads_started":1}
I20260812 11:22:08.289702 13275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } }
I20260812 11:22:08.290189 13275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:08.290308 13275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308d5b3540e84705936010784ad4c10d, State: Initialized, Role: FOLLOWER
I20260812 11:22:08.291021 13275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } }
I20260812 11:22:08.291304 13275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:08.291428 13275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:08.291554 13275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:08.293671 13275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } }
I20260812 11:22:08.294116 13275 leader_election.cc:302] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 308d5b3540e84705936010784ad4c10d; no voters:
I20260812 11:22:08.294793 13275 leader_election.cc:288] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:08.294948 13283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:08.296258 13283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [term 1 LEADER]: Becoming Leader. State: Replica: 308d5b3540e84705936010784ad4c10d, State: Running, Role: LEADER
I20260812 11:22:08.296868 13283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } }
I20260812 11:22:08.297222 13275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:08.300426 13289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 308d5b3540e84705936010784ad4c10d. Latest consensus state: current_term: 1 leader_uuid: "308d5b3540e84705936010784ad4c10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } } }
I20260812 11:22:08.300472 13287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "308d5b3540e84705936010784ad4c10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "308d5b3540e84705936010784ad4c10d" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 42103 } } }
I20260812 11:22:08.300945 13289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:08.300973 13287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:08.302098 13295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:08.310303 13295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:08.324991 13295 catalog_manager.cc:1347] Generated new cluster ID: 51f40159bbcd4a79a35463dfd642ec28
I20260812 11:22:08.325163 13295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:08.334137 13295 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:08.335688 13295 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:08.355055 13295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: Generated new TSK 0
I20260812 11:22:08.356196 13295 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:22:08.437649 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:08.797051 13320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:08.797360 13320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:08.797565 13320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:08.805399 13320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:08.805567 13320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:08.805774 13320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:08.816486 13320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:08.817907 13320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:08.819420 13320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:08.833840 13330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:08.833896 13327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:08.833791 13328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:08.836151 13320 server_base.cc:1034] running on GCE node
I20260812 11:22:08.836951 13320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:08.838040 13320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:08.839299 13320 hybrid_clock.cc:648] HybridClock initialized: now 1786533728839240 us; error 49 us; skew 500 ppm
I20260812 11:22:08.839802 13320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:08 dist-test-slave-7kzw krb5kdc[13156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533728, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:08.843451 13320 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:22:08.845233 13320 webserver.cc:460] Webserver started at http://127.15.164.193:36115/ using document root <none> and password file <none>
I20260812 11:22:08.846027 13320 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:08.846190 13320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:08.846621 13320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:08.849900 13320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "39fec770dedb64b1e75964f50c5e1b18"
server_key_iv: "4f6995aff18f8243f8a2269d66533692"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.850828 13320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "39fec770dedb64b1e75964f50c5e1b18"
server_key_iv: "4f6995aff18f8243f8a2269d66533692"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.856441 13320 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:08.860595 13343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:08.862017 13320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:08.862205 13320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7"
format_stamp: "Formatted at 2026-08-12 11:22:08 on dist-test-slave-7kzw"
server_key: "39fec770dedb64b1e75964f50c5e1b18"
server_key_iv: "4f6995aff18f8243f8a2269d66533692"
server_key_version: "encryptionkey@0"
I20260812 11:22:08.862429 13320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:08.902648 13320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:08.907544 13320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:08.907877 13320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:08.909705 13320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:08.911547 13320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:08.911672 13320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:08.911839 13320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:08.911917 13320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:08.948987 13320 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:39181
I20260812 11:22:08.949036 13539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:39181 every 8 connection(s)
I20260812 11:22:08.950417 13320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:08.959416 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 13320
I20260812 11:22:08.959636 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:08.960341 16019 external_mini_cluster.cc:1428] Setting key 13d4ed5af4f14e9bcd734edf26743132
Aug 12 11:22:08 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533728, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:08.973353 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:08.953308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:42951 (local address 127.15.164.254:42103)
0812 11:22:08.953789 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:08.953796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:08.954911 (+ 1115us) server_negotiation.cc:407] Connection header received
0812 11:22:08.956735 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:08.956740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:08.956825 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:08.956927 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:08.958446 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.959599 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.961768 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.962282 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.962397 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:08.966170 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:08.966180 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:08.966187 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:08.966234 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:08.969915 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:08.970746 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:08.970755 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:08.970761 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:08.970917 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:08.971353 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:08.971361 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:08.971367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:08.971754 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:08.971910 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:08.972609 (+ 699us) server_negotiation.cc:299] Negotiation successful
0812 11:22:08.972865 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":216,"threads_started":1}
I20260812 11:22:08.974246 13544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:08.953926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42103 (local address 127.15.164.193:42951)
0812 11:22:08.954736 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:08.954787 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:08.956475 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:08.957135 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:08.957160 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:08.957679 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:08.958252 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:08.958270 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.959829 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.959835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:08.961622 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:08.961638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:08.962574 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:08.962584 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:08.962800 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:08.963561 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:08.963586 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:08.965908 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:08.970076 (+ 4168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:08.970083 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:08.970096 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:08.970616 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:08.971033 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:08.971036 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:08.971038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:08.971228 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:08.971882 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:08.971888 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:08.972204 (+ 316us) client_negotiation.cc:769] Sending connection context
0812 11:22:08.972433 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 11:22:08.972849 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":296,"threads_started":1}
I20260812 11:22:08.975919 13541 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42103
I20260812 11:22:08.976260 13541 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:08.977018 13541 heartbeater.cc:511] Master 127.15.164.254:42103 requested a full tablet report, sending...
I20260812 11:22:08.979847 13224 ts_manager.cc:194] Registered new tserver with Master: 85b30303f9b54edfaf0dd27d4a9dc1e7 (127.15.164.193:39181)
I20260812 11:22:08.982151 13224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:42951
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:22:09.032451 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:09.386111 13552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:09.386389 13552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:09.386536 13552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:09.393657 13552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:09.393803 13552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:09.393980 13552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:09.404186 13552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:09.405524 13552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:09.406931 13552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:09.420622 13560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:09.420603 13563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:09.420534 13567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:09.421526 13552 server_base.cc:1034] running on GCE node
I20260812 11:22:09.422103 13552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:09.423107 13552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:09.424316 13552 hybrid_clock.cc:648] HybridClock initialized: now 1786533729424280 us; error 29 us; skew 500 ppm
I20260812 11:22:09.424641 13552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:09 dist-test-slave-7kzw krb5kdc[13156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:09.428051 13552 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:22:09.429615 13552 webserver.cc:460] Webserver started at http://127.15.164.194:39341/ using document root <none> and password file <none>
I20260812 11:22:09.430308 13552 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:09.430423 13552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:09.430781 13552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:09.433684 13552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "aa6d897030c44a5e9652607ecb271998"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "a6b3e399d755143d19a917a0475094ed"
server_key_iv: "d975581d1cdf17b1bd5295d79db91809"
server_key_version: "encryptionkey@0"
I20260812 11:22:09.434434 13552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "aa6d897030c44a5e9652607ecb271998"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "a6b3e399d755143d19a917a0475094ed"
server_key_iv: "d975581d1cdf17b1bd5295d79db91809"
server_key_version: "encryptionkey@0"
I20260812 11:22:09.439810 13552 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:22:09.443593 13577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:09.445060 13552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:09.445207 13552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "aa6d897030c44a5e9652607ecb271998"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "a6b3e399d755143d19a917a0475094ed"
server_key_iv: "d975581d1cdf17b1bd5295d79db91809"
server_key_version: "encryptionkey@0"
I20260812 11:22:09.445387 13552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:09.462742 13552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:09.467469 13552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:09.467721 13552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:09.468698 13552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:09.470095 13552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:09.470175 13552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:09.470265 13552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:09.470311 13552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:09.505573 13552 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:45645
I20260812 11:22:09.505615 13753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:45645 every 8 connection(s)
I20260812 11:22:09.507057 13552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:09.514672 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 13552
I20260812 11:22:09.514873 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:09.515350 16019 external_mini_cluster.cc:1428] Setting key 8c99c9b3fd7f3e1733833d8a6d7abec7
Aug 12 11:22:09 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:09.529155 13760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:09.509992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:52599 (local address 127.15.164.254:42103)
0812 11:22:09.510541 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:09.510545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:09.511878 (+ 1333us) server_negotiation.cc:407] Connection header received
0812 11:22:09.513924 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:09.513930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:09.514040 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:09.514186 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:09.516139 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:09.517162 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:09.518933 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:09.519393 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:09.519534 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:09.523163 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:09.523169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:09.523172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:09.523204 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:09.525935 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:09.526734 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:09.526738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:09.526740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:09.526872 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:09.527364 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:09.527368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:09.527370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:09.527659 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:09.527821 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:09.528531 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 11:22:09.528771 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":263,"threads_started":1}
I20260812 11:22:09.530164 13762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:09.510770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42103 (local address 127.15.164.194:52599)
0812 11:22:09.511688 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:09.511739 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:09.513626 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:09.514505 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:09.514522 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:09.515204 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:09.515898 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:09.515927 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:09.517385 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:09.517391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:09.518783 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:09.518796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:09.519671 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:09.519680 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:09.519913 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:09.520680 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:09.520705 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:09.522914 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:09.526078 (+ 3164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:09.526088 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:09.526104 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:09.526600 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:09.526991 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:09.526996 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:09.527000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:09.527210 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:09.527795 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:09.527803 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:09.528166 (+ 363us) client_negotiation.cc:769] Sending connection context
0812 11:22:09.528428 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 11:22:09.528951 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":363,"threads_started":1}
I20260812 11:22:09.531797 13756 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42103
I20260812 11:22:09.532383 13756 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:09.533234 13756 heartbeater.cc:511] Master 127.15.164.254:42103 requested a full tablet report, sending...
I20260812 11:22:09.534797 13224 ts_manager.cc:194] Registered new tserver with Master: aa6d897030c44a5e9652607ecb271998 (127.15.164.194:45645)
I20260812 11:22:09.535640 13224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:52599
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:22:09.586230 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:09.943504 13766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:09.943854 13766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:09.944023 13766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:09.953095 13766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:09.953265 13766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:09.953451 13766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:09.963539 13766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:42103
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:09.964861 13766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:09.966434 13766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:09.980504 13772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:09.980576 13776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:09.980760 13774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:09.981961 13766 server_base.cc:1034] running on GCE node
I20260812 11:22:09.982600 13766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:09.983496 13766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:09.984772 13766 hybrid_clock.cc:648] HybridClock initialized: now 1786533729984710 us; error 50 us; skew 500 ppm
I20260812 11:22:09.985078 13766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:09.985502 13541 heartbeater.cc:503] Master 127.15.164.254:42103 was elected leader, sending a full tablet report...
Aug 12 11:22:09 dist-test-slave-7kzw krb5kdc[13156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:09.988688 13766 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:22:09.990187 13766 webserver.cc:460] Webserver started at http://127.15.164.195:35065/ using document root <none> and password file <none>
I20260812 11:22:09.990947 13766 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:09.991101 13766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:09.991437 13766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:09.994412 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "28e7012374114bd1ad20f32714a5470e"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "2d8b9bb7a366bca741c49da240273483"
server_key_iv: "828ee8556f1c2a0950f6a88c55d6e756"
server_key_version: "encryptionkey@0"
I20260812 11:22:09.995296 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "28e7012374114bd1ad20f32714a5470e"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "2d8b9bb7a366bca741c49da240273483"
server_key_iv: "828ee8556f1c2a0950f6a88c55d6e756"
server_key_version: "encryptionkey@0"
I20260812 11:22:10.000984 13766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:10.005342 13786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:10.007103 13766 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:22:10.007345 13766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "28e7012374114bd1ad20f32714a5470e"
format_stamp: "Formatted at 2026-08-12 11:22:09 on dist-test-slave-7kzw"
server_key: "2d8b9bb7a366bca741c49da240273483"
server_key_iv: "828ee8556f1c2a0950f6a88c55d6e756"
server_key_version: "encryptionkey@0"
I20260812 11:22:10.007611 13766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:10.032593 13766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:10.037860 13766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:10.038205 13766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:10.039389 13766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:10.040936 13766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:10.041060 13766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:10.041229 13766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:10.041311 13766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:10.078225 13766 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:40831
I20260812 11:22:10.078321 13962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:40831 every 8 connection(s)
I20260812 11:22:10.079680 13766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:10.085806 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 13766
I20260812 11:22:10.086021 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:10.086546 16019 external_mini_cluster.cc:1428] Setting key 07a1b19d894c968d6beeb7886a0d1ea9
Aug 12 11:22:10 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533729, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:10.100682 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.082436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:41391 (local address 127.15.164.254:42103)
0812 11:22:10.082928 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.082933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.083962 (+ 1029us) server_negotiation.cc:407] Connection header received
0812 11:22:10.085854 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.085860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.085990 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.086122 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:10.087964 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.088771 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.090316 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.090793 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.090934 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.094528 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:10.094534 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:10.094537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:10.094570 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:10.097296 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.098179 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.098187 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.098195 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.098324 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.098836 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.098840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.098842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.099121 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:10.099300 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.100032 (+ 732us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.100277 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":241,"threads_started":1}
I20260812 11:22:10.101730 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.083003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:42103 (local address 127.15.164.195:41391)
0812 11:22:10.083790 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.083839 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.085541 (+ 1702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.086375 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.086383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.087033 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:10.087763 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.087789 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.088928 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.088934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.090166 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.090179 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.091027 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.091046 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.091293 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.092013 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:10.092037 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:10.094279 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:10.097455 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:10.097464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:10.097482 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:10.098030 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:10.098444 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:10.098449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:10.098453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:10.098690 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:10.099273 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:10.099281 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:10.099634 (+ 353us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.099930 (+ 296us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.100479 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":309,"threads_started":1}
I20260812 11:22:10.103106 13963 heartbeater.cc:347] Connected to a master server at 127.15.164.254:42103
I20260812 11:22:10.103440 13963 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:10.104183 13963 heartbeater.cc:511] Master 127.15.164.254:42103 requested a full tablet report, sending...
I20260812 11:22:10.105639 13224 ts_manager.cc:194] Registered new tserver with Master: 28e7012374114bd1ad20f32714a5470e (127.15.164.195:40831)
I20260812 11:22:10.106419 13224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:41391
I20260812 11:22:10.114120 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:10.132434 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.118399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.15.164.254:42103)
0812 11:22:10.118725 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.118734 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.119011 (+ 277us) server_negotiation.cc:407] Connection header received
0812 11:22:10.119234 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.119239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.119313 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.119422 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:10.120933 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.121676 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.123092 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.123504 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.123665 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.126681 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:10.126693 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:10.126697 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:10.126730 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:10.129422 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.130254 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.130259 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.130261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.130387 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.130926 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.130930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.130932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.131238 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:10.131552 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.131931 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.132135 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260812 11:22:10.136808 13224 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:10.143813 13224 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:10.180706 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.158793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.15.164.194:45645)
0812 11:22:10.167560 (+ 8767us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.167575 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.171481 (+ 3906us) server_negotiation.cc:407] Connection header received
0812 11:22:10.171589 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.171596 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.171786 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.171961 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:10.174000 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.175653 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.177956 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.179233 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.179395 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.179595 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.180182 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.180350 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8520,"thread_start_us":8325,"threads_started":1}
I20260812 11:22:10.180763 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.157577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:45645 (local address 127.0.0.1:51438)
0812 11:22:10.171181 (+ 13604us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.171200 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.171333 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.172410 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.172416 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.172439 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:10.173375 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.173395 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.175839 (+ 2444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.175844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.177787 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.177801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.179761 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.179768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.179913 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.179948 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.180113 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.180313 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13436,"mutex_wait_us":107,"thread_start_us":14562,"threads_started":1}
I20260812 11:22:10.181531 13982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.157049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40831 (local address 127.0.0.1:42602)
0812 11:22:10.170725 (+ 13676us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.170800 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.171165 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.172302 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.172312 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.172348 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:10.173456 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.173469 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.175569 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.175577 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.177950 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.177965 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.180572 (+ 2607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.180578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.180740 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.180777 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.180862 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.180999 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13281,"mutex_wait_us":162,"thread_start_us":13103,"threads_started":1}
I20260812 11:22:10.182209 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.158262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34548 (local address 127.15.164.193:39181)
0812 11:22:10.168307 (+ 10045us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.168320 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.173431 (+ 5111us) server_negotiation.cc:407] Connection header received
0812 11:22:10.173737 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.173749 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.173992 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.174212 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:10.175094 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.176684 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.179288 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.180760 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.180960 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.181117 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.181698 (+ 581us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.181850 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9806,"thread_start_us":9611,"threads_started":1}
I20260812 11:22:10.182397 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.157361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42602 (local address 127.15.164.195:40831)
0812 11:22:10.169735 (+ 12374us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.169748 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.170963 (+ 1215us) server_negotiation.cc:407] Connection header received
0812 11:22:10.171449 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.171458 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.171746 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.171928 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:10.173719 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.175404 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.178592 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.180033 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.180197 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.180366 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.181855 (+ 1489us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.182022 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12134,"thread_start_us":12396,"threads_started":1}
I20260812 11:22:10.182088 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.157850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:39181 (local address 127.0.0.1:34548)
0812 11:22:10.173281 (+ 15431us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.173296 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.173478 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.174515 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.174521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.174549 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:10.174898 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.174909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.176838 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.176843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.179103 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.179118 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.181267 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.181273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.181458 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.181503 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.181601 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.181743 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15302,"mutex_wait_us":21,"thread_start_us":15061,"threads_started":1}
I20260812 11:22:10.185273 13654 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6135e389664121ae96d35d712f8bcf (DEFAULT_TABLE table=test-table [id=87d0efb544fb4972be658e46a2c054e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:10.185738 13868 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6135e389664121ae96d35d712f8bcf (DEFAULT_TABLE table=test-table [id=87d0efb544fb4972be658e46a2c054e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:10.186669 13654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6135e389664121ae96d35d712f8bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:10.187072 13868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6135e389664121ae96d35d712f8bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:10.196219 13430 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6135e389664121ae96d35d712f8bcf (DEFAULT_TABLE table=test-table [id=87d0efb544fb4972be658e46a2c054e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:10.197872 13430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6135e389664121ae96d35d712f8bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:10.198601 13989 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Bootstrap starting.
I20260812 11:22:10.202379 13990 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Bootstrap starting.
I20260812 11:22:10.203063 13989 tablet_bootstrap.cc:654] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:10.204437 13989 log.cc:824] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:10.206185 13990 tablet_bootstrap.cc:654] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:10.207566 13990 log.cc:824] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:10.207957 13989 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: No bootstrap required, opened a new log
I20260812 11:22:10.208307 13989 ts_tablet_manager.cc:1397] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 11:22:10.210942 13990 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: No bootstrap required, opened a new log
I20260812 11:22:10.211311 13990 ts_tablet_manager.cc:1397] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 11:22:10.215231 13996 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Bootstrap starting.
I20260812 11:22:10.218554 13996 tablet_bootstrap.cc:654] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:10.219588 13996 log.cc:824] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:10.219843 13989 raft_consensus.cc:348] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.220319 13989 raft_consensus.cc:374] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:10.220431 13989 raft_consensus.cc:729] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6d897030c44a5e9652607ecb271998, State: Initialized, Role: FOLLOWER
I20260812 11:22:10.221060 13989 consensus_queue.cc:260] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.222434 13756 heartbeater.cc:503] Master 127.15.164.254:42103 was elected leader, sending a full tablet report...
I20260812 11:22:10.222445 13990 raft_consensus.cc:348] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.222941 13990 raft_consensus.cc:374] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:10.223071 13989 ts_tablet_manager.cc:1428] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 11:22:10.223044 13990 raft_consensus.cc:729] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7012374114bd1ad20f32714a5470e, State: Initialized, Role: FOLLOWER
I20260812 11:22:10.223793 13990 consensus_queue.cc:260] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.224057 13996 tablet_bootstrap.cc:492] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: No bootstrap required, opened a new log
I20260812 11:22:10.224382 13996 ts_tablet_manager.cc:1397] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:22:10.225006 13963 heartbeater.cc:503] Master 127.15.164.254:42103 was elected leader, sending a full tablet report...
I20260812 11:22:10.225625 13990 ts_tablet_manager.cc:1428] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260812 11:22:10.233588 13996 raft_consensus.cc:348] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.233923 13996 raft_consensus.cc:374] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:10.233999 13996 raft_consensus.cc:729] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b30303f9b54edfaf0dd27d4a9dc1e7, State: Initialized, Role: FOLLOWER
I20260812 11:22:10.234622 13996 consensus_queue.cc:260] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.236267 13996 ts_tablet_manager.cc:1428] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
W20260812 11:22:10.259266 13757 tablet.cc:2369] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:10.331388 13964 tablet.cc:2369] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:10.453402 13542 tablet.cc:2369] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:10.453550 14006 raft_consensus.cc:482] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:10.453931 14006 raft_consensus.cc:504] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.455780 14006 leader_election.cc:288] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28e7012374114bd1ad20f32714a5470e (127.15.164.195:40831), aa6d897030c44a5e9652607ecb271998 (127.15.164.194:45645)
I20260812 11:22:10.462798 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.456511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:42889 (local address 127.15.164.194:45645)
0812 11:22:10.456789 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.456798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.457375 (+ 577us) server_negotiation.cc:407] Connection header received
0812 11:22:10.457607 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.457618 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.457687 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.457788 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:10.458434 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.459209 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.461003 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.461766 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.461956 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.462037 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.462370 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.462521 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:22:10.462821 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.456283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53213 (local address 127.15.164.195:40831)
0812 11:22:10.456627 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.456632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.457417 (+ 785us) server_negotiation.cc:407] Connection header received
0812 11:22:10.457638 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.457642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.457704 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.457814 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:10.458535 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.459278 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.461041 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.461812 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.461994 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.462077 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.462406 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.462554 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260812 11:22:10.462952 14013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.456253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:40831 (local address 127.15.164.193:53213)
0812 11:22:10.457305 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.457320 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.457488 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.457830 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.457834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.457858 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:10.458334 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.458345 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.459429 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.459444 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.460879 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.460892 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.462058 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.462064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.462224 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.462268 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.462388 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.462545 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"mutex_wait_us":4,"thread_start_us":721,"threads_started":1}
I20260812 11:22:10.463297 14011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.456071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:45645 (local address 127.15.164.193:42889)
0812 11:22:10.457245 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:10.457267 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:10.457462 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:10.457812 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:10.457817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:10.457844 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:10.458286 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.458299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.459350 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.459356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.460851 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:10.460864 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.462004 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.462010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:10.462173 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.462225 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:22:10.462331 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:22:10.462459 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"mutex_wait_us":45,"thread_start_us":751,"threads_started":1}
I20260812 11:22:10.464097 13899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6135e389664121ae96d35d712f8bcf" candidate_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7012374114bd1ad20f32714a5470e" is_pre_election: true
I20260812 11:22:10.464267 13685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6135e389664121ae96d35d712f8bcf" candidate_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6d897030c44a5e9652607ecb271998" is_pre_election: true
I20260812 11:22:10.464749 13899 raft_consensus.cc:2454] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b30303f9b54edfaf0dd27d4a9dc1e7 in term 0.
I20260812 11:22:10.464782 13685 raft_consensus.cc:2454] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b30303f9b54edfaf0dd27d4a9dc1e7 in term 0.
I20260812 11:22:10.465509 13349 leader_election.cc:302] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b30303f9b54edfaf0dd27d4a9dc1e7, aa6d897030c44a5e9652607ecb271998; no voters:
I20260812 11:22:10.466050 14006 raft_consensus.cc:2781] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:10.466209 14006 raft_consensus.cc:482] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:10.466332 14006 raft_consensus.cc:3037] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:10.469076 14006 raft_consensus.cc:504] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.469713 14006 leader_election.cc:288] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 28e7012374114bd1ad20f32714a5470e (127.15.164.195:40831), aa6d897030c44a5e9652607ecb271998 (127.15.164.194:45645)
I20260812 11:22:10.470146 13899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6135e389664121ae96d35d712f8bcf" candidate_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7012374114bd1ad20f32714a5470e"
I20260812 11:22:10.470165 13685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6135e389664121ae96d35d712f8bcf" candidate_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6d897030c44a5e9652607ecb271998"
I20260812 11:22:10.470345 13899 raft_consensus.cc:3037] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:10.470371 13685 raft_consensus.cc:3037] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:10.472520 13899 raft_consensus.cc:2454] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b30303f9b54edfaf0dd27d4a9dc1e7 in term 1.
I20260812 11:22:10.472575 13685 raft_consensus.cc:2454] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b30303f9b54edfaf0dd27d4a9dc1e7 in term 1.
I20260812 11:22:10.472971 13350 leader_election.cc:302] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7012374114bd1ad20f32714a5470e, 85b30303f9b54edfaf0dd27d4a9dc1e7; no voters:
I20260812 11:22:10.473311 14006 raft_consensus.cc:2781] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:10.473802 14006 raft_consensus.cc:686] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 1 LEADER]: Becoming Leader. State: Replica: 85b30303f9b54edfaf0dd27d4a9dc1e7, State: Running, Role: LEADER
I20260812 11:22:10.474344 14006 consensus_queue.cc:237] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } }
I20260812 11:22:10.479079 13222 catalog_manager.cc:5495] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b30303f9b54edfaf0dd27d4a9dc1e7 (127.15.164.193). New cstate: current_term: 1 leader_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85b30303f9b54edfaf0dd27d4a9dc1e7" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 39181 } health_report { overall_health: HEALTHY } } }
I20260812 11:22:10.553071 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.547055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34558 (local address 127.15.164.193:39181)
0812 11:22:10.547285 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.547293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.547392 (+ 99us) server_negotiation.cc:407] Connection header received
0812 11:22:10.547638 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.547643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.547722 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.547894 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:10.548299 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.549035 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.550616 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.551046 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.551207 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.551853 (+ 646us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:10.552460 (+ 607us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:10.552659 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.552794 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.552846 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:22:10.561213 13685 raft_consensus.cc:1261] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 1 FOLLOWER]: Refusing update from remote peer 85b30303f9b54edfaf0dd27d4a9dc1e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:10.561232 13899 raft_consensus.cc:1261] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 1 FOLLOWER]: Refusing update from remote peer 85b30303f9b54edfaf0dd27d4a9dc1e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:10.562175 14014 consensus_queue.cc:1035] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7012374114bd1ad20f32714a5470e" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 40831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:10.562549 14006 consensus_queue.cc:1035] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6d897030c44a5e9652607ecb271998" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 45645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:10.595600 13224 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:10.595911 13224 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:10.599786 13224 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 308d5b3540e84705936010784ad4c10d: Sending DeleteTablet for 3 replicas of tablet 6b6135e389664121ae96d35d712f8bcf
I20260812 11:22:10.600932 13868 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6135e389664121ae96d35d712f8bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:10 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:42602
I20260812 11:22:10.601075 13654 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6135e389664121ae96d35d712f8bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:10 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:51438
I20260812 11:22:10.601162 13430 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6135e389664121ae96d35d712f8bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:10 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:34548
I20260812 11:22:10.603847 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 13320
I20260812 11:22:10.610093 14036 tablet_replica.cc:330] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: stopping tablet replica
I20260812 11:22:10.610658 14036 raft_consensus.cc:2229] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:10.611340 14036 raft_consensus.cc:2258] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:10.613991 14036 ts_tablet_manager.cc:1905] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:10.614566 14038 tablet_replica.cc:330] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: stopping tablet replica
I20260812 11:22:10.614959 14038 raft_consensus.cc:2229] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:10.615427 14038 raft_consensus.cc:2258] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:10.617570 14038 ts_tablet_manager.cc:1905] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:10.619064 14037 tablet_replica.cc:330] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: stopping tablet replica
I20260812 11:22:10.619508 14037 raft_consensus.cc:2229] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:10.620322 14037 raft_consensus.cc:2258] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:10.621301 14036 ts_tablet_manager.cc:1918] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:10.621483 14036 log.cc:1196] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/6b6135e389664121ae96d35d712f8bcf
I20260812 11:22:10.622025 14036 ts_tablet_manager.cc:1939] T 6b6135e389664121ae96d35d712f8bcf P 28e7012374114bd1ad20f32714a5470e: Deleting consensus metadata
I20260812 11:22:10.623992 13203 catalog_manager.cc:4841] TS 28e7012374114bd1ad20f32714a5470e (127.15.164.195:40831): tablet 6b6135e389664121ae96d35d712f8bcf (table test-table [id=87d0efb544fb4972be658e46a2c054e9]) successfully deleted
Aug 12 11:22:10 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:22:10.626497 14037 ts_tablet_manager.cc:1905] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:10.627625 14038 ts_tablet_manager.cc:1918] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:10.627797 14038 log.cc:1196] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/6b6135e389664121ae96d35d712f8bcf
I20260812 11:22:10.628701 14038 ts_tablet_manager.cc:1939] T 6b6135e389664121ae96d35d712f8bcf P aa6d897030c44a5e9652607ecb271998: Deleting consensus metadata
I20260812 11:22:10.630587 13202 catalog_manager.cc:4841] TS aa6d897030c44a5e9652607ecb271998 (127.15.164.194:45645): tablet 6b6135e389664121ae96d35d712f8bcf (table test-table [id=87d0efb544fb4972be658e46a2c054e9]) successfully deleted
I20260812 11:22:10.634263 14037 ts_tablet_manager.cc:1918] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:10.634488 14037 log.cc:1196] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/6b6135e389664121ae96d35d712f8bcf
I20260812 11:22:10.634855 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.609534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34568 (local address 127.15.164.193:39181)
0812 11:22:10.610304 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.610313 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.610338 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:22:10.610413 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.610421 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.610551 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.610677 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:10.613757 (+ 3080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.615334 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.618880 (+ 3546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.619638 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.619745 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.626015 (+ 6270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:10.626030 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:10.626049 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:10.626095 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:10.630549 (+ 4454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.631596 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.631612 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.631617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.631810 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.632366 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.632372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.632375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.632874 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:10.633181 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.633843 (+ 662us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.634091 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613}
I20260812 11:22:10.635044 14037 ts_tablet_manager.cc:1939] T 6b6135e389664121ae96d35d712f8bcf P 85b30303f9b54edfaf0dd27d4a9dc1e7: Deleting consensus metadata
I20260812 11:22:10.635584 13532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:10.735356 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 13320
I20260812 11:22:10.735390 13204 catalog_manager.cc:4841] TS 85b30303f9b54edfaf0dd27d4a9dc1e7 (127.15.164.193:39181): tablet 6b6135e389664121ae96d35d712f8bcf (table test-table [id=87d0efb544fb4972be658e46a2c054e9]) successfully deleted
I20260812 11:22:10.766214 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 13552
Aug 12 11:22:10 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:22:10.781813 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.767059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.15.164.194:45645)
0812 11:22:10.767246 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.767250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.767296 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:22:10.767423 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.767427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.767496 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.767582 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:10.768949 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.769681 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.771152 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.771534 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.771637 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.775985 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:10.775999 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:10.776017 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:10.776054 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:10.778853 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.779710 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.779725 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.779730 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.779940 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.780424 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.780429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.780432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.780873 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:10.781108 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.781382 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.781546 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:22:10.782572 13748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:10.873148 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 13552
I20260812 11:22:10.901255 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 13766
Aug 12 11:22:10 dist-test-slave-7kzw krb5kdc[13156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:22:10.918452 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:10.902235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42606 (local address 127.15.164.195:40831)
0812 11:22:10.902421 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:10.902426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:10.902448 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:10.902777 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:10.902782 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:10.902861 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:10.902965 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:10.904555 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.905393 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.906881 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:10.907369 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:10.907490 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:10.912540 (+ 5050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:10.912558 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:10.912609 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:10.912676 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:10.915659 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.916385 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.916393 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.916395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.916550 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:10.916933 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:10.916937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:10.916939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:10.917348 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:10.917578 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:10.917887 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:22:10.918055 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:22:10.919188 13958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:11.009657 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 13766
I20260812 11:22:11.037376 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 13174
I20260812 11:22:11.038699 13270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:11.150858 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 13174
2026-08-12T11:22:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5052 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T11:22:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:11Z Disabled control of system clock
I20260812 11:22:11.251412 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35837
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:45377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:35837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:11.603775 14052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:11.604112 14052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:11.604200 14052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:11.611666 14052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:11.611788 14052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:11.611826 14052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:11.611877 14052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:11.611930 14052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:11.621326 14052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:35837
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:11.622725 14052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:11.624596 14052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:11.637218 14061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:11.637329 14059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:11.637291 14065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:11.638047 14052 server_base.cc:1034] running on GCE node
I20260812 11:22:11.638949 14052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:11.640487 14052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:11.641727 14052 hybrid_clock.cc:648] HybridClock initialized: now 1786533731641677 us; error 71 us; skew 500 ppm
I20260812 11:22:11.642093 14052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:11.644606 14052 webserver.cc:460] Webserver started at http://127.15.164.254:45409/ using document root <none> and password file <none>
I20260812 11:22:11.645364 14052 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:11.645506 14052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:11.645861 14052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:11.649420 14052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9"
format_stamp: "Formatted at 2026-08-12 11:22:11 on dist-test-slave-7kzw"
server_key: "e92729435a06ac65b05f3afbec800613"
server_key_iv: "60bae2c74f1b76dba754ccb7c308bd70"
server_key_version: "encryptionkey@0"
I20260812 11:22:11.650640 14052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9"
format_stamp: "Formatted at 2026-08-12 11:22:11 on dist-test-slave-7kzw"
server_key: "e92729435a06ac65b05f3afbec800613"
server_key_iv: "60bae2c74f1b76dba754ccb7c308bd70"
server_key_version: "encryptionkey@0"
I20260812 11:22:11.656329 14052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:22:11.659866 14073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:11.661239 14052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:11.661450 14052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9"
format_stamp: "Formatted at 2026-08-12 11:22:11 on dist-test-slave-7kzw"
server_key: "e92729435a06ac65b05f3afbec800613"
server_key_iv: "60bae2c74f1b76dba754ccb7c308bd70"
server_key_version: "encryptionkey@0"
I20260812 11:22:11.661688 14052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:11.680626 14052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:11.681478 14052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:11.681782 14052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:11.701201 14052 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:35837
I20260812 11:22:11.701241 14147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:35837 every 8 connection(s)
I20260812 11:22:11.702661 14052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:11.706699 14148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:11.708801 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 14052
I20260812 11:22:11.708995 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:11.709616 16019 external_mini_cluster.cc:1428] Setting key c30d0369702c864f9a7510d1c6aa2c39
I20260812 11:22:11.720557 14148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: Bootstrap starting.
I20260812 11:22:11.724370 14148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:11.724695 14152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:11.711631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48280 (local address 127.15.164.254:35837)
0812 11:22:11.712852 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:11.712866 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:11.712909 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:22:11.714723 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:11.714749 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:11.715210 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:11.715525 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:11.716208 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:11.718101 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:11.720054 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:11.720791 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:11.720923 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:11.722229 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:11.722237 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:11.722250 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:11.722899 (+ 649us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:11.722990 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:11.723011 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:11.723100 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:11.723353 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 11:22:11.723689 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":471,"threads_started":1}
I20260812 11:22:11.725528 14148 log.cc:824] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:11.728678 14148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: No bootstrap required, opened a new log
I20260812 11:22:11.736006 14148 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } }
I20260812 11:22:11.736392 14148 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:11.736553 14148 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee9c9c6cbb4033bf6bf56a18d6b4e9, State: Initialized, Role: FOLLOWER
I20260812 11:22:11.737251 14148 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } }
I20260812 11:22:11.737475 14148 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:11.737582 14148 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:11.737722 14148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:11.739930 14148 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } }
I20260812 11:22:11.740378 14148 leader_election.cc:302] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcee9c9c6cbb4033bf6bf56a18d6b4e9; no voters:
I20260812 11:22:11.740921 14148 leader_election.cc:288] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:11.741097 14155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:11.741835 14155 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [term 1 LEADER]: Becoming Leader. State: Replica: dcee9c9c6cbb4033bf6bf56a18d6b4e9, State: Running, Role: LEADER
I20260812 11:22:11.742362 14155 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } }
I20260812 11:22:11.743155 14148 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:11.745467 14157 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } } }
I20260812 11:22:11.745832 14157 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:11.746951 14158 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcee9c9c6cbb4033bf6bf56a18d6b4e9. Latest consensus state: current_term: 1 leader_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcee9c9c6cbb4033bf6bf56a18d6b4e9" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35837 } } }
I20260812 11:22:11.747300 14158 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:11.747478 14163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:11.753441 14163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:11.762377 14163 catalog_manager.cc:1347] Generated new cluster ID: 9d38bb8c7719435c8c13d7d44586c0c9
I20260812 11:22:11.762519 14163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:11.773300 14163 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:11.774612 14163 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:11.790563 14163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: Generated new TSK 0
I20260812 11:22:11.791719 14163 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:11.798015 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--builtin_ntp_servers=127.15.164.212:45377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:12.200956 14189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:12.201288 14189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:12.201385 14189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:12.208949 14189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:12.209064 14189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:12.209172 14189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:12.218410 14189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:12.219725 14189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:12.221526 14189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:12.235594 14201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:12.235643 14198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:12.235643 14199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:12.236776 14189 server_base.cc:1034] running on GCE node
I20260812 11:22:12.237429 14189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:12.238420 14189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:12.239729 14189 hybrid_clock.cc:648] HybridClock initialized: now 1786533732239681 us; error 36 us; skew 500 ppm
I20260812 11:22:12.240083 14189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:12.242458 14189 webserver.cc:460] Webserver started at http://127.15.164.193:42071/ using document root <none> and password file <none>
I20260812 11:22:12.243251 14189 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:12.243376 14189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:12.243729 14189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:12.246799 14189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "3f8c625f062d4d208e52936b2e3ce6b1"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "ea4b169365d8e07ecca211c38cc360de"
server_key_iv: "73de581c85dc7c5cb1488428c7cf2088"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.247802 14189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "3f8c625f062d4d208e52936b2e3ce6b1"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "ea4b169365d8e07ecca211c38cc360de"
server_key_iv: "73de581c85dc7c5cb1488428c7cf2088"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.253863 14189 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:22:12.257679 14209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.259047 14189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:22:12.259227 14189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "3f8c625f062d4d208e52936b2e3ce6b1"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "ea4b169365d8e07ecca211c38cc360de"
server_key_iv: "73de581c85dc7c5cb1488428c7cf2088"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.259449 14189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:12.278614 14189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:12.279544 14189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:12.279889 14189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:12.280934 14189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:12.282585 14189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:12.282720 14189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.282857 14189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:12.282953 14189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.318451 14189 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:40765
I20260812 11:22:12.318619 14388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:40765 every 8 connection(s)
I20260812 11:22:12.319994 14189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:12.326412 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 14189
I20260812 11:22:12.326704 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:12.327483 16019 external_mini_cluster.cc:1428] Setting key c0613cb94ff2ca54e6883be9a6e94af4
I20260812 11:22:12.330435 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--builtin_ntp_servers=127.15.164.212:45377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:12.334136 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:12.322945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:41959 (local address 127.15.164.254:35837)
0812 11:22:12.323436 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:12.323441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:12.324654 (+ 1213us) server_negotiation.cc:407] Connection header received
0812 11:22:12.326992 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:12.326997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:12.327072 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:12.327175 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:12.328593 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.329469 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.331240 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.331642 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.331792 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:12.333254 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:12.333260 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:12.333264 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:12.333282 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:12.333326 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:12.333338 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:12.333440 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:12.333678 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 11:22:12.333790 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":250,"threads_started":1}
I20260812 11:22:12.335274 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:12.323556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35837 (local address 127.15.164.193:41959)
0812 11:22:12.324485 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:12.324521 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:12.326655 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:12.327514 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:12.327531 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:12.327659 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:12.328427 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:12.328445 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.329628 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.329636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:12.331083 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:12.331098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.331884 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.331893 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:12.332143 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:12.332902 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:12.332905 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:12.332948 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:12.333035 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:12.333443 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:12.333457 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:12.333467 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:22:12.333666 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 11:22:12.334081 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":277,"threads_started":1}
I20260812 11:22:12.336889 14389 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35837
I20260812 11:22:12.337260 14389 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:12.338246 14389 heartbeater.cc:511] Master 127.15.164.254:35837 requested a full tablet report, sending...
I20260812 11:22:12.340744 14095 ts_manager.cc:194] Registered new tserver with Master: 3f8c625f062d4d208e52936b2e3ce6b1 (127.15.164.193:40765)
I20260812 11:22:12.342661 14095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.193:41959
W20260812 11:22:12.678953 14396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:12.679282 14396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:12.679443 14396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:12.686771 14396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:12.686908 14396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:12.687094 14396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:12.696224 14396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:12.697602 14396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:12.699417 14396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:12.714649 14405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:12.714669 14404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:12.714907 14410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:12.715837 14396 server_base.cc:1034] running on GCE node
I20260812 11:22:12.716521 14396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:12.717653 14396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:12.718875 14396 hybrid_clock.cc:648] HybridClock initialized: now 1786533732718809 us; error 57 us; skew 500 ppm
I20260812 11:22:12.719230 14396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:12.721818 14396 webserver.cc:460] Webserver started at http://127.15.164.194:35865/ using document root <none> and password file <none>
I20260812 11:22:12.722451 14396 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:12.722632 14396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:12.722905 14396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:12.725622 14396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "b7614fb0ef9486280d6f9584f3ce0af4"
server_key_iv: "63dc91e881a085d977cda08317a07292"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.726325 14396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "b7614fb0ef9486280d6f9584f3ce0af4"
server_key_iv: "63dc91e881a085d977cda08317a07292"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.731388 14396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 11:22:12.734900 14421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.736371 14396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:22:12.736589 14396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45"
format_stamp: "Formatted at 2026-08-12 11:22:12 on dist-test-slave-7kzw"
server_key: "b7614fb0ef9486280d6f9584f3ce0af4"
server_key_iv: "63dc91e881a085d977cda08317a07292"
server_key_version: "encryptionkey@0"
I20260812 11:22:12.736845 14396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:12.766168 14396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:12.767145 14396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:12.767486 14396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:12.768553 14396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:12.770128 14396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:12.770218 14396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.770308 14396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:12.770363 14396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:12.804215 14396 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:44437
I20260812 11:22:12.804313 14591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:44437 every 8 connection(s)
I20260812 11:22:12.805567 14396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:12.813160 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 14396
I20260812 11:22:12.813376 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:12.813851 16019 external_mini_cluster.cc:1428] Setting key 9d4b659ac5beac022745bfaed9e420de
I20260812 11:22:12.816817 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--builtin_ntp_servers=127.15.164.212:45377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:12.818660 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:12.808367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:48575 (local address 127.15.164.254:35837)
0812 11:22:12.808568 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:12.808573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:12.809946 (+ 1373us) server_negotiation.cc:407] Connection header received
0812 11:22:12.811752 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:12.811757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:12.811830 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:12.811922 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:12.812958 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.813796 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.815585 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.816160 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.816329 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:12.817811 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:12.817816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:12.817819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:12.817837 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:12.817869 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:12.817880 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:12.817979 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:12.818211 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 11:22:12.818320 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:22:12.819693 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:12.808854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35837 (local address 127.15.164.194:48575)
0812 11:22:12.809764 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:12.809801 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:12.811481 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:12.812126 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:12.812134 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:12.812219 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:12.812780 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:12.812797 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.813958 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.813965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:12.815431 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:12.815444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:12.816439 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:12.816447 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:12.816677 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:12.817472 (+ 795us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:12.817475 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:12.817516 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:12.817596 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:12.817982 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:12.817996 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:12.818006 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:22:12.818198 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 11:22:12.818621 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":279,"threads_started":1}
I20260812 11:22:12.821132 14594 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35837
I20260812 11:22:12.821463 14594 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:12.822280 14594 heartbeater.cc:511] Master 127.15.164.254:35837 requested a full tablet report, sending...
I20260812 11:22:12.823911 14095 ts_manager.cc:194] Registered new tserver with Master: 7f8c7f0306dd4505a6c5c7ddcf18dd45 (127.15.164.194:44437)
I20260812 11:22:12.825146 14095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.194:48575
W20260812 11:22:13.167567 14597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:13.167906 14597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:13.168090 14597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:13.175319 14597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:13.175472 14597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:13.175666 14597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:13.184962 14597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:13.186394 14597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:13.188362 14597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:13.201961 14607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:13.201963 14608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:13.202129 14612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:13.202826 14597 server_base.cc:1034] running on GCE node
I20260812 11:22:13.203413 14597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:13.204396 14597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:13.205657 14597 hybrid_clock.cc:648] HybridClock initialized: now 1786533733205663 us; error 96 us; skew 500 ppm
I20260812 11:22:13.205986 14597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:13.212628 14597 webserver.cc:460] Webserver started at http://127.15.164.195:33355/ using document root <none> and password file <none>
I20260812 11:22:13.213415 14597 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:13.213560 14597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:13.213904 14597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:13.216934 14597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "7e773c2f32e94da8aa5c55ea82608a75"
format_stamp: "Formatted at 2026-08-12 11:22:13 on dist-test-slave-7kzw"
server_key: "5d70aaa7c0f04cd9b48dc0bcf8f018a0"
server_key_iv: "81a7bb229dad1b36a3e25753dfb3e257"
server_key_version: "encryptionkey@0"
I20260812 11:22:13.217795 14597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "7e773c2f32e94da8aa5c55ea82608a75"
format_stamp: "Formatted at 2026-08-12 11:22:13 on dist-test-slave-7kzw"
server_key: "5d70aaa7c0f04cd9b48dc0bcf8f018a0"
server_key_iv: "81a7bb229dad1b36a3e25753dfb3e257"
server_key_version: "encryptionkey@0"
I20260812 11:22:13.223011 14597 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 11:22:13.226408 14621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:13.227775 14597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:13.227947 14597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "7e773c2f32e94da8aa5c55ea82608a75"
format_stamp: "Formatted at 2026-08-12 11:22:13 on dist-test-slave-7kzw"
server_key: "5d70aaa7c0f04cd9b48dc0bcf8f018a0"
server_key_iv: "81a7bb229dad1b36a3e25753dfb3e257"
server_key_version: "encryptionkey@0"
I20260812 11:22:13.228161 14597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:13.241513 14597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:13.242374 14597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:13.242785 14597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:13.243791 14597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:13.245306 14597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:13.245434 14597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:13.245574 14597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:13.245698 14597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:13.280766 14597 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:38025
I20260812 11:22:13.280820 14817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:38025 every 8 connection(s)
I20260812 11:22:13.282146 14597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:13.288906 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 14597
I20260812 11:22:13.289113 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:13.289695 16019 external_mini_cluster.cc:1428] Setting key 775a808deada66f39ea7ea96d2da328a
I20260812 11:22:13.295792 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.284932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:46717 (local address 127.15.164.254:35837)
0812 11:22:13.285165 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.285171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.286497 (+ 1326us) server_negotiation.cc:407] Connection header received
0812 11:22:13.288370 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.288375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.288472 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.288566 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:13.290055 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.291047 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.293113 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.293544 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.293664 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.295042 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:13.295048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:13.295053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:13.295075 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:13.295114 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:13.295131 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:13.295226 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.295429 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.295514 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:22:13.296689 14822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.285412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:35837 (local address 127.15.164.195:46717)
0812 11:22:13.286312 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.286349 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.288079 (+ 1730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.288856 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.288867 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.288986 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:13.289853 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.289877 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.291269 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.291274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.292958 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.292974 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.293744 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.293749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.293948 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.294721 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:13.294723 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:13.294762 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:13.294834 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:13.295235 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:13.295243 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:13.295249 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.295387 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.295659 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":287,"threads_started":1}
I20260812 11:22:13.298067 14819 heartbeater.cc:347] Connected to a master server at 127.15.164.254:35837
I20260812 11:22:13.298336 14819 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:13.299139 14819 heartbeater.cc:511] Master 127.15.164.254:35837 requested a full tablet report, sending...
I20260812 11:22:13.300514 14095 ts_manager.cc:194] Registered new tserver with Master: 7e773c2f32e94da8aa5c55ea82608a75 (127.15.164.195:38025)
I20260812 11:22:13.301311 14095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.195:46717
I20260812 11:22:13.305302 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:13.315714 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.309700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.15.164.254:35837)
0812 11:22:13.309893 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.309897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.310346 (+ 449us) server_negotiation.cc:407] Connection header received
0812 11:22:13.310460 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.310537 (+ 77us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.310619 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.310713 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:13.311232 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.311906 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.313265 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.313711 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.313816 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.315040 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:13.315045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:13.315049 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:13.315068 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:13.315100 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:13.315113 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:13.315256 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.315441 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.315485 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:22:13.320055 14095 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:13.328737 14095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:13.346388 14389 heartbeater.cc:503] Master 127.15.164.254:35837 was elected leader, sending a full tablet report...
I20260812 11:22:13.353595 14842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.342283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54176 (local address 127.15.164.193:40765)
0812 11:22:13.344197 (+ 1914us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.344206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.344299 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:22:13.344467 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.344479 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.344773 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.345510 (+ 737us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:13.346047 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.347774 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.350614 (+ 2840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.352244 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.352467 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.352722 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.352993 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.353179 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1716,"thread_start_us":1600,"threads_started":1}
I20260812 11:22:13.353628 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.341926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54176)
0812 11:22:13.343110 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.343206 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.343494 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.345074 (+ 1580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.345086 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.345136 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:13.345783 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.345808 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.347980 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.347986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.350347 (+ 2361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.350364 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.352453 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.352461 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.352704 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.352774 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.352935 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.353170 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":35,"thread_start_us":627,"threads_started":1}
I20260812 11:22:13.356280 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.343377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38025 (local address 127.0.0.1:44760)
0812 11:22:13.346259 (+ 2882us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.346280 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.346421 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.347496 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.347503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.348989 (+ 1486us) spinlock_profiling.cc:243] Waited 942 us on lock 0x61200002c1a8. stack: 00007f7bc5e7066e 00007f7bc5e70430 00007f7bc4ef75ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f7bc5e660fd 00007f7bc5e65d1e 00007f7bd8d6f3cd 00007f7bd8d6f36c 00007f7bd8d3bb3b 00007f7bcc8778e9 00007f7bcc873e45 00007f7bcc8fbdca 00007f7bcc8f9f68 00007f7bcc92d82f
0812 11:22:13.349010 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:13.349621 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.349643 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.351508 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.351515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.353405 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.353419 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.355183 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.355189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.355450 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.355500 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.355634 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.355768 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2735,"mutex_wait_us":106,"spinlock_wait_cycles":2166656,"thread_start_us":2550,"threads_started":1}
I20260812 11:22:13.357293 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.343969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44760 (local address 127.15.164.195:38025)
0812 11:22:13.345879 (+ 1910us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.345890 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.346552 (+ 662us) server_negotiation.cc:407] Connection header received
0812 11:22:13.346761 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.346769 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.346981 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.347186 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:13.349852 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.351272 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.353613 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.355020 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.355223 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.355451 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.356776 (+ 1325us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.356942 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1705,"thread_start_us":1535,"threads_started":1}
I20260812 11:22:13.358037 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.342252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:44437 (local address 127.0.0.1:56498)
0812 11:22:13.346072 (+ 3820us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.346090 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.346299 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.347232 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.347239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.347844 (+ 605us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:13.349651 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.349663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.351555 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.351569 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.355261 (+ 3692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.355276 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.357423 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.357429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.357608 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.357632 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.357708 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.357791 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2962,"mutex_wait_us":62,"thread_start_us":2995,"threads_started":1}
I20260812 11:22:13.358377 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.342840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.15.164.194:44437)
0812 11:22:13.344892 (+ 2052us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.344904 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.346186 (+ 1282us) server_negotiation.cc:407] Connection header received
0812 11:22:13.346528 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.346536 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.346757 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.346937 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:13.349952 (+ 3015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.351353 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.355494 (+ 4141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.356892 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.357020 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.357235 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.357807 (+ 572us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.357973 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1879,"thread_start_us":1788,"threads_started":1}
I20260812 11:22:13.358049 14285 tablet_service.cc:1467] Processing CreateTablet for tablet c0045020f5b9422d919c78a1b38f1fee (DEFAULT_TABLE table=test-table [id=474efa0acc944b49bd6dac703bd1aca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:13.359611 14285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0045020f5b9422d919c78a1b38f1fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:13.361407 14495 tablet_service.cc:1467] Processing CreateTablet for tablet c0045020f5b9422d919c78a1b38f1fee (DEFAULT_TABLE table=test-table [id=474efa0acc944b49bd6dac703bd1aca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:13.362819 14495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0045020f5b9422d919c78a1b38f1fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:13.364988 14697 tablet_service.cc:1467] Processing CreateTablet for tablet c0045020f5b9422d919c78a1b38f1fee (DEFAULT_TABLE table=test-table [id=474efa0acc944b49bd6dac703bd1aca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:13.366533 14697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0045020f5b9422d919c78a1b38f1fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:13.373911 14847 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Bootstrap starting.
I20260812 11:22:13.377789 14847 tablet_bootstrap.cc:654] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:13.378988 14847 log.cc:824] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:13.379261 14849 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Bootstrap starting.
I20260812 11:22:13.382524 14853 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Bootstrap starting.
I20260812 11:22:13.382884 14849 tablet_bootstrap.cc:654] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:13.383354 14847 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: No bootstrap required, opened a new log
I20260812 11:22:13.383636 14847 ts_tablet_manager.cc:1397] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260812 11:22:13.384863 14849 log.cc:824] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:13.386396 14853 tablet_bootstrap.cc:654] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:13.387648 14853 log.cc:824] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:13.388331 14849 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: No bootstrap required, opened a new log
I20260812 11:22:13.388649 14849 ts_tablet_manager.cc:1397] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:22:13.390301 14853 tablet_bootstrap.cc:492] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: No bootstrap required, opened a new log
I20260812 11:22:13.390656 14853 ts_tablet_manager.cc:1397] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260812 11:22:13.394172 14847 raft_consensus.cc:348] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.394761 14847 raft_consensus.cc:374] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:13.395001 14847 raft_consensus.cc:729] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8c7f0306dd4505a6c5c7ddcf18dd45, State: Initialized, Role: FOLLOWER
I20260812 11:22:13.395838 14847 consensus_queue.cc:260] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.397071 14594 heartbeater.cc:503] Master 127.15.164.254:35837 was elected leader, sending a full tablet report...
I20260812 11:22:13.397640 14847 ts_tablet_manager.cc:1428] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260812 11:22:13.399600 14853 raft_consensus.cc:348] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.400000 14853 raft_consensus.cc:374] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:13.399766 14849 raft_consensus.cc:348] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.400148 14853 raft_consensus.cc:729] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e773c2f32e94da8aa5c55ea82608a75, State: Initialized, Role: FOLLOWER
I20260812 11:22:13.400184 14849 raft_consensus.cc:374] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:13.400283 14849 raft_consensus.cc:729] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8c625f062d4d208e52936b2e3ce6b1, State: Initialized, Role: FOLLOWER
I20260812 11:22:13.400775 14853 consensus_queue.cc:260] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.400974 14849 consensus_queue.cc:260] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.402336 14853 ts_tablet_manager.cc:1428] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260812 11:22:13.402788 14819 heartbeater.cc:503] Master 127.15.164.254:35837 was elected leader, sending a full tablet report...
I20260812 11:22:13.405287 14849 ts_tablet_manager.cc:1428] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Time spent starting tablet: real 0.017s user 0.008s sys 0.007s
W20260812 11:22:13.534009 14821 tablet.cc:2369] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:13.557920 14595 tablet.cc:2369] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:13.566834 14859 raft_consensus.cc:482] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:13.567247 14859 raft_consensus.cc:504] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.569578 14859 leader_election.cc:288] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8c625f062d4d208e52936b2e3ce6b1 (127.15.164.193:40765), 7e773c2f32e94da8aa5c55ea82608a75 (127.15.164.195:38025)
W20260812 11:22:13.572603 14391 tablet.cc:2369] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:13.578299 14842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.570129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:35013 (local address 127.15.164.193:40765)
0812 11:22:13.570397 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.570404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.570797 (+ 393us) server_negotiation.cc:407] Connection header received
0812 11:22:13.571082 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.571092 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.571234 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.571387 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:13.572146 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.573312 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.575877 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.577340 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.577563 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.577667 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.577872 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.578059 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:22:13.578435 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.569887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.15.164.194:35013)
0812 11:22:13.570652 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.570669 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.570863 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.571469 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.571476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.571513 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:13.571978 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.571992 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.573480 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.573484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.575610 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.575626 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.577564 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.577568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.577693 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.577719 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.577798 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.578035 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":48,"thread_start_us":423,"threads_started":1}
I20260812 11:22:13.578941 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.570924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:38025 (local address 127.15.164.194:36871)
0812 11:22:13.571702 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.571723 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:13.571868 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:13.572349 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:13.572355 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:13.572381 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:13.572788 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.572803 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.574093 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.574099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.576080 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:13.576090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.578074 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.578080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:13.578248 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.578282 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:22:13.578389 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 11:22:13.578571 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":24,"thread_start_us":401,"threads_started":1}
I20260812 11:22:13.579311 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.571137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:36871 (local address 127.15.164.195:38025)
0812 11:22:13.571354 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.571362 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.571857 (+ 495us) server_negotiation.cc:407] Connection header received
0812 11:22:13.572041 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.572099 (+ 58us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.572194 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.572312 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:13.573033 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.573948 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.576294 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.577755 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.577978 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.578068 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.578861 (+ 793us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.578973 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:22:13.579838 14321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0045020f5b9422d919c78a1b38f1fee" candidate_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" is_pre_election: true
I20260812 11:22:13.580570 14321 raft_consensus.cc:2454] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8c7f0306dd4505a6c5c7ddcf18dd45 in term 0.
I20260812 11:22:13.580611 14739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0045020f5b9422d919c78a1b38f1fee" candidate_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e773c2f32e94da8aa5c55ea82608a75" is_pre_election: true
I20260812 11:22:13.581230 14739 raft_consensus.cc:2454] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8c7f0306dd4505a6c5c7ddcf18dd45 in term 0.
I20260812 11:22:13.581357 14425 leader_election.cc:302] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8c625f062d4d208e52936b2e3ce6b1, 7f8c7f0306dd4505a6c5c7ddcf18dd45; no voters:
I20260812 11:22:13.581918 14859 raft_consensus.cc:2781] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:13.582136 14859 raft_consensus.cc:482] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:13.582294 14859 raft_consensus.cc:3037] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:13.585251 14859 raft_consensus.cc:504] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.585959 14859 leader_election.cc:288] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8c625f062d4d208e52936b2e3ce6b1 (127.15.164.193:40765), 7e773c2f32e94da8aa5c55ea82608a75 (127.15.164.195:38025)
I20260812 11:22:13.586519 14739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0045020f5b9422d919c78a1b38f1fee" candidate_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e773c2f32e94da8aa5c55ea82608a75"
I20260812 11:22:13.586472 14321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0045020f5b9422d919c78a1b38f1fee" candidate_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8c625f062d4d208e52936b2e3ce6b1"
I20260812 11:22:13.586735 14321 raft_consensus.cc:3037] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:13.586735 14739 raft_consensus.cc:3037] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:13.589990 14321 raft_consensus.cc:2454] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8c7f0306dd4505a6c5c7ddcf18dd45 in term 1.
I20260812 11:22:13.589988 14739 raft_consensus.cc:2454] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8c7f0306dd4505a6c5c7ddcf18dd45 in term 1.
I20260812 11:22:13.590371 14425 leader_election.cc:302] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e773c2f32e94da8aa5c55ea82608a75, 7f8c7f0306dd4505a6c5c7ddcf18dd45; no voters:
I20260812 11:22:13.590701 14859 raft_consensus.cc:2781] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:13.591168 14859 raft_consensus.cc:686] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 1 LEADER]: Becoming Leader. State: Replica: 7f8c7f0306dd4505a6c5c7ddcf18dd45, State: Running, Role: LEADER
I20260812 11:22:13.591663 14859 consensus_queue.cc:237] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } }
I20260812 11:22:13.596658 14094 catalog_manager.cc:5495] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f8c7f0306dd4505a6c5c7ddcf18dd45 (127.15.164.194). New cstate: current_term: 1 leader_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f8c7f0306dd4505a6c5c7ddcf18dd45" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 44437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260812 11:22:13.653843 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.648208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.15.164.194:44437)
0812 11:22:13.648391 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.648395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.648413 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:22:13.648497 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.648507 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.648595 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.648730 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:13.649083 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.649944 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.651498 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.651958 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.652071 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.652658 (+ 587us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:13.653204 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:13.653339 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.653499 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.653563 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:22:13.663872 14739 raft_consensus.cc:1261] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 1 FOLLOWER]: Refusing update from remote peer 7f8c7f0306dd4505a6c5c7ddcf18dd45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:13.664157 14321 raft_consensus.cc:1261] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 1 FOLLOWER]: Refusing update from remote peer 7f8c7f0306dd4505a6c5c7ddcf18dd45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:13.665158 14868 consensus_queue.cc:1035] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e773c2f32e94da8aa5c55ea82608a75" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:13.665679 14859 consensus_queue.cc:1035] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8c625f062d4d208e52936b2e3ce6b1" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:13.683630 14873 mvcc.cc:205] Tried to move back new op lower bound from 7317642173073784832 to 7317642172795097088. Current Snapshot: MvccSnapshot[applied={T|T < 7317642173073784832}]
I20260812 11:22:13.688612 14877 mvcc.cc:205] Tried to move back new op lower bound from 7317642173073784832 to 7317642172795097088. Current Snapshot: MvccSnapshot[applied={T|T < 7317642173073784832}]
I20260812 11:22:13.697081 14095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:13.697355 14095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:13.701107 14095 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dcee9c9c6cbb4033bf6bf56a18d6b4e9: Sending DeleteTablet for 3 replicas of tablet c0045020f5b9422d919c78a1b38f1fee
I20260812 11:22:13.702219 14495 tablet_service.cc:1514] Processing DeleteTablet for tablet c0045020f5b9422d919c78a1b38f1fee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:13 UTC) from {username='slave'} at 127.0.0.1:56498
I20260812 11:22:13.702329 14285 tablet_service.cc:1514] Processing DeleteTablet for tablet c0045020f5b9422d919c78a1b38f1fee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:13 UTC) from {username='slave'} at 127.0.0.1:54176
I20260812 11:22:13.703617 14697 tablet_service.cc:1514] Processing DeleteTablet for tablet c0045020f5b9422d919c78a1b38f1fee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:13 UTC) from {username='slave'} at 127.0.0.1:44760
I20260812 11:22:13.707823 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 14189
I20260812 11:22:13.712394 14887 tablet_replica.cc:330] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: stopping tablet replica
I20260812 11:22:13.713022 14887 raft_consensus.cc:2229] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:13.713640 14887 raft_consensus.cc:2258] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:13.718163 14887 ts_tablet_manager.cc:1905] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:13.723271 14885 tablet_replica.cc:330] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: stopping tablet replica
I20260812 11:22:13.723788 14885 raft_consensus.cc:2229] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:13.724588 14885 raft_consensus.cc:2258] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:13.726218 14886 tablet_replica.cc:330] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1: stopping tablet replica
I20260812 11:22:13.728329 14885 ts_tablet_manager.cc:1905] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:13.728889 14887 ts_tablet_manager.cc:1918] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:13.729070 14887 log.cc:1196] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/c0045020f5b9422d919c78a1b38f1fee
I20260812 11:22:13.729099 14842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.708936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.15.164.193:40765)
0812 11:22:13.709122 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.709129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.719007 (+ 9878us) server_negotiation.cc:407] Connection header received
0812 11:22:13.719353 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.719360 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.719490 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.719593 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:13.720323 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.721660 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.723913 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.724641 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.724758 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.727168 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:13.727181 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:13.727199 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:13.728038 (+ 839us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:13.728115 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:13.728144 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:13.728236 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.728528 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.728672 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:22:13.729725 14887 ts_tablet_manager.cc:1939] T c0045020f5b9422d919c78a1b38f1fee P 7e773c2f32e94da8aa5c55ea82608a75: Deleting consensus metadata
I20260812 11:22:13.730429 14384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:13.732379 14077 catalog_manager.cc:4841] TS 7e773c2f32e94da8aa5c55ea82608a75 (127.15.164.195:38025): tablet c0045020f5b9422d919c78a1b38f1fee (table test-table [id=474efa0acc944b49bd6dac703bd1aca7]) successfully deleted
I20260812 11:22:13.737205 14885 ts_tablet_manager.cc:1918] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:13.737531 14885 log.cc:1196] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/c0045020f5b9422d919c78a1b38f1fee
I20260812 11:22:13.738181 14885 ts_tablet_manager.cc:1939] T c0045020f5b9422d919c78a1b38f1fee P 7f8c7f0306dd4505a6c5c7ddcf18dd45: Deleting consensus metadata
I20260812 11:22:13.740262 14078 catalog_manager.cc:4841] TS 7f8c7f0306dd4505a6c5c7ddcf18dd45 (127.15.164.194:44437): tablet c0045020f5b9422d919c78a1b38f1fee (table test-table [id=474efa0acc944b49bd6dac703bd1aca7]) successfully deleted
I20260812 11:22:13.736896 14886 raft_consensus.cc:2229] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:13.855260 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 14189
I20260812 11:22:13.855408 14886 raft_consensus.cc:2258] T c0045020f5b9422d919c78a1b38f1fee P 3f8c625f062d4d208e52936b2e3ce6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 11:22:13.887734 14077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.164.193:40765 (error 108)
I20260812 11:22:13.888092 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 14396
I20260812 11:22:13.890301 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.889414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54194)
0812 11:22:13.889892 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.890050 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":255,"threads_started":1}
W20260812 11:22:13.890614 14077 catalog_manager.cc:4584] TS 3f8c625f062d4d208e52936b2e3ce6b1 (127.15.164.193:40765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0045020f5b9422d919c78a1b38f1fee: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
I20260812 11:22:13.896900 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.889474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56516 (local address 127.15.164.194:44437)
0812 11:22:13.889685 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:13.889693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:13.889719 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:22:13.889803 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:13.889808 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:13.889938 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:13.890063 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:13.890663 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.891574 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.893487 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:13.893934 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:13.894045 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:13.895236 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:13.895246 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:13.895277 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:13.895923 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:13.895971 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:13.895992 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:13.896088 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:13.896253 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 11:22:13.896348 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:22:13.897660 14586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:13.944356 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.943803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54206)
0812 11:22:13.944038 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.944153 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 11:22:13.945573 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:13.945129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54220)
0812 11:22:13.945308 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:13.945396 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:22:14.006536 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.005895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54236)
0812 11:22:14.006155 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:14.006305 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 11:22:14.007874 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.007385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54242)
0812 11:22:14.007579 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:14.007688 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 11:22:14.012902 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 14396
I20260812 11:22:14.039958 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 14597
I20260812 11:22:14.047132 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.040801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44762 (local address 127.15.164.195:38025)
0812 11:22:14.040964 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:14.040969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:14.041001 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:22:14.041217 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:14.041221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:14.041307 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:14.041405 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:14.041767 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:14.042547 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:14.043869 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:14.044285 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:14.044377 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:14.045443 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:14.045452 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:14.045468 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:14.046052 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:14.046101 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:14.046120 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:14.046234 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:14.046568 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 11:22:14.046705 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:22:14.047906 14805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:14.088687 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.088171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54246)
0812 11:22:14.088413 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:14.088510 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 11:22:14.089993 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.089538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54258)
0812 11:22:14.089752 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:14.089837 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260812 11:22:14.137413 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 14597
I20260812 11:22:14.164633 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 14052
I20260812 11:22:14.165791 14141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:14.277354 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 14052
I20260812 11:22:14.277438 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:14.276751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:40765 (local address 127.0.0.1:54272)
0812 11:22:14.277125 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:14.277275 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:40765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
2026-08-12T11:22:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:14 dist-test-slave-7kzw krb5kdc[14906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:14 dist-test-slave-7kzw krb5kdc[14906](info): set up 2 sockets
Aug 12 11:22:14 dist-test-slave-7kzw krb5kdc[14906](info): commencing operation
krb5kdc: starting...
W20260812 11:22:15.704847 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.372s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:15 dist-test-slave-7kzw krb5kdc[14906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:16.014019 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41243
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:16.369091 14924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:16.369462 14924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:16.369637 14924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:16.376910 14924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:16.377069 14924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:16.377197 14924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:16.377298 14924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:16.377391 14924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:16.387436 14924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:16.388859 14924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:16.390252 14924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:16.402897 14931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:16.402837 14933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:16.402940 14930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:16.404301 14924 server_base.cc:1034] running on GCE node
I20260812 11:22:16.405122 14924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:16.406665 14924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:16.407955 14924 hybrid_clock.cc:648] HybridClock initialized: now 1786533736407909 us; error 50 us; skew 500 ppm
I20260812 11:22:16.408378 14924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:16 dist-test-slave-7kzw krb5kdc[14906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533736, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:16.411816 14924 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:16.413372 14924 webserver.cc:460] Webserver started at http://127.15.164.254:38575/ using document root <none> and password file <none>
I20260812 11:22:16.414108 14924 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:16.414214 14924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:16.414522 14924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:16.417667 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0"
format_stamp: "Formatted at 2026-08-12 11:22:16 on dist-test-slave-7kzw"
server_key: "78f95c2a947aca16861bd4fe9e2d88e4"
server_key_iv: "ff847387886d0a0413545f9ea685c40f"
server_key_version: "encryptionkey@0"
I20260812 11:22:16.418407 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0"
format_stamp: "Formatted at 2026-08-12 11:22:16 on dist-test-slave-7kzw"
server_key: "78f95c2a947aca16861bd4fe9e2d88e4"
server_key_iv: "ff847387886d0a0413545f9ea685c40f"
server_key_version: "encryptionkey@0"
I20260812 11:22:16.423797 14924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 11:22:16.427520 14943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:16.429016 14924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:16.429248 14924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0"
format_stamp: "Formatted at 2026-08-12 11:22:16 on dist-test-slave-7kzw"
server_key: "78f95c2a947aca16861bd4fe9e2d88e4"
server_key_iv: "ff847387886d0a0413545f9ea685c40f"
server_key_version: "encryptionkey@0"
I20260812 11:22:16.429438 14924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:16.450156 14924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:16.454942 14924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:16.455276 14924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:16.474761 14924 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41243
I20260812 11:22:16.474869 15033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41243 every 8 connection(s)
I20260812 11:22:16.476187 14924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:16.480131 15034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:16.485432 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 14924
I20260812 11:22:16.485697 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:16.486153 16019 external_mini_cluster.cc:1428] Setting key 52d37600be50e03cac31fed4b407a2ce
I20260812 11:22:16.491106 15034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: Bootstrap starting.
I20260812 11:22:16.494894 15034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:16.496109 15034 log.cc:824] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:16.499404 15034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: No bootstrap required, opened a new log
Aug 12 11:22:16 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:16.508587 15034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } }
I20260812 11:22:16.509050 15034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:16.509214 15034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c30fe5a31db4ebe87b6fc7ed37fe1c0, State: Initialized, Role: FOLLOWER
I20260812 11:22:16.509923 15034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } }
I20260812 11:22:16.510249 15034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:16.510434 15034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:16.510720 15034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:16.510818 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:16.488271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.15.164.254:41243)
0812 11:22:16.489201 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:16.489212 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:16.489253 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:22:16.490984 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:16.491007 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:16.491428 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:16.491754 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:16.493743 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:16.495371 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:16.497193 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:16.497856 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:16.498073 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:16.502833 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:16.502843 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:16.502861 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:16.502904 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:16.506192 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:16.507040 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:16.507048 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:16.507054 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:16.507236 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:16.507661 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:16.507668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:16.507682 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:16.508223 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:16.508529 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:16.509015 (+ 486us) server_negotiation.cc:299] Negotiation successful
0812 11:22:16.509484 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":440,"threads_started":1}
I20260812 11:22:16.513988 15034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } }
I20260812 11:22:16.514644 15034 leader_election.cc:302] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c30fe5a31db4ebe87b6fc7ed37fe1c0; no voters:
I20260812 11:22:16.515323 15034 leader_election.cc:288] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:16.515496 15043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:16.516868 15043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 8c30fe5a31db4ebe87b6fc7ed37fe1c0, State: Running, Role: LEADER
I20260812 11:22:16.517361 15043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } }
I20260812 11:22:16.517721 15034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:16.520318 15045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c30fe5a31db4ebe87b6fc7ed37fe1c0. Latest consensus state: current_term: 1 leader_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } } }
I20260812 11:22:16.521121 15045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:16.521251 15044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c30fe5a31db4ebe87b6fc7ed37fe1c0" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41243 } } }
I20260812 11:22:16.521620 15044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:16.524188 15054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:16.530108 15054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:16.539496 15054 catalog_manager.cc:1347] Generated new cluster ID: 6802e899004a4aea8163156e9840cf5a
I20260812 11:22:16.539633 15054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:16.557200 15054 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:16.559122 15054 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:16.572022 15054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: Generated new TSK 0
I20260812 11:22:16.572883 15054 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
Entry for principal kudu/127.15.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab.
I20260812 11:22:16.654146 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:17.034456 15072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:17.034812 15072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:17.034909 15072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:17.042363 15072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:17.042601 15072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:17.042814 15072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:17.052822 15072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.193.keytab
--principal=kudu/127.15.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:17.054132 15072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:17.055586 15072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:17.069510 15082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:17.069615 15077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:17.069523 15084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:17.072039 15072 server_base.cc:1034] running on GCE node
I20260812 11:22:17.072685 15072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:17.073647 15072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:17.074877 15072 hybrid_clock.cc:648] HybridClock initialized: now 1786533737074832 us; error 35 us; skew 500 ppm
I20260812 11:22:17.075218 15072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:17 dist-test-slave-7kzw krb5kdc[14906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:17.078589 15072 init.cc:377] Logged in from keytab as kudu/127.15.164.193@KRBTEST.COM (short username kudu)
I20260812 11:22:17.080217 15072 webserver.cc:460] Webserver started at http://127.15.164.193:37329/ using document root <none> and password file <none>
I20260812 11:22:17.080977 15072 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:17.081128 15072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:17.081470 15072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:17.084471 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "8fed8a972bc8474f9b434e4845986f4f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "195cf36bc76161cbe6d20eb2d3f4bad3"
server_key_iv: "223a2cbc3cc3bc168a3e892c1e17a262"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.085259 15072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "8fed8a972bc8474f9b434e4845986f4f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "195cf36bc76161cbe6d20eb2d3f4bad3"
server_key_iv: "223a2cbc3cc3bc168a3e892c1e17a262"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.090597 15072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:22:17.094039 15093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.095391 15072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:17.095572 15072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "8fed8a972bc8474f9b434e4845986f4f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "195cf36bc76161cbe6d20eb2d3f4bad3"
server_key_iv: "223a2cbc3cc3bc168a3e892c1e17a262"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.095796 15072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:17.111711 15072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:17.116660 15072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:17.116999 15072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:17.118418 15072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:17.120400 15072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:17.120496 15072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.120649 15072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:17.120721 15072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.158186 15072 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:44221
I20260812 11:22:17.158233 15296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:44221 every 8 connection(s)
I20260812 11:22:17.159582 15072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:17.161160 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 15072
I20260812 11:22:17.161365 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:17.161953 16019 external_mini_cluster.cc:1428] Setting key 3376d941ed4b4be1ccf82498f9de90f9
Aug 12 11:22:17 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.193@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:17.183307 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:17.162403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:53457 (local address 127.15.164.254:41243)
0812 11:22:17.162940 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:17.162946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:17.164099 (+ 1153us) server_negotiation.cc:407] Connection header received
0812 11:22:17.165914 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:17.165923 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:17.166018 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:17.166144 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:17.167837 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.168984 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.170720 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.171428 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.171587 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:17.175850 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:17.175856 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:17.175859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:17.175895 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:17.179650 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:17.180452 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:17.180461 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:17.180467 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:17.180665 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:17.181145 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:17.181153 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:17.181159 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:17.181588 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:17.181749 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:17.182542 (+ 793us) server_negotiation.cc:299] Negotiation successful
0812 11:22:17.182824 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":295,"threads_started":1}
I20260812 11:22:17.184072 15300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:17.162982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41243 (local address 127.15.164.193:53457)
0812 11:22:17.163855 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:17.163900 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:17.165627 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:17.166340 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:17.166348 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:17.167063 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:17.167647 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:17.167665 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.169194 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.169198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:17.170567 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:17.170587 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.171709 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.171715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:17.171934 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:17.172715 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:17.172742 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:17.175576 (+ 2834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:17.179830 (+ 4254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:17.179838 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:17.179852 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:17.180303 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:17.180811 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:17.180815 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:17.180817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:17.181014 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:17.181719 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:17.181725 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:17.182089 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 11:22:17.182333 (+ 244us) client_negotiation.cc:240] Negotiation successful
0812 11:22:17.182837 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":351,"threads_started":1}
I20260812 11:22:17.185931 15297 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41243
I20260812 11:22:17.186280 15297 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:17.187148 15297 heartbeater.cc:511] Master 127.15.164.254:41243 requested a full tablet report, sending...
I20260812 11:22:17.189641 14968 ts_manager.cc:194] Registered new tserver with Master: 8fed8a972bc8474f9b434e4845986f4f (127.15.164.193:44221)
I20260812 11:22:17.192045 14968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.193@KRBTEST.COM'} at 127.15.164.193:53457
WARNING: no policy specified for kudu/127.15.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
Entry for principal kudu/127.15.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab.
I20260812 11:22:17.234143 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:17.575912 15306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:17.576256 15306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:17.576431 15306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:17.583580 15306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:17.583732 15306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:17.583902 15306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:17.593405 15306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.194.keytab
--principal=kudu/127.15.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:17.594719 15306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:17.596042 15306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:17.609438 15325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:17.609490 15318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:17.610172 15316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:17.610327 15306 server_base.cc:1034] running on GCE node
I20260812 11:22:17.611066 15306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:17.612181 15306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:17.613484 15306 hybrid_clock.cc:648] HybridClock initialized: now 1786533737613419 us; error 54 us; skew 500 ppm
I20260812 11:22:17.613838 15306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:17 dist-test-slave-7kzw krb5kdc[14906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:17.617164 15306 init.cc:377] Logged in from keytab as kudu/127.15.164.194@KRBTEST.COM (short username kudu)
I20260812 11:22:17.618850 15306 webserver.cc:460] Webserver started at http://127.15.164.194:38689/ using document root <none> and password file <none>
I20260812 11:22:17.619786 15306 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:17.619925 15306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:17.620280 15306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:17.623389 15306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "bd492cabb46a4f478c0b1ddeac27fd0f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "de2b236d7166b444420f45c3b088c222"
server_key_iv: "344a093e53ed148dfebe478b67644af3"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.624176 15306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "bd492cabb46a4f478c0b1ddeac27fd0f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "de2b236d7166b444420f45c3b088c222"
server_key_iv: "344a093e53ed148dfebe478b67644af3"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.629304 15306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:22:17.632822 15337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.634434 15306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:22:17.634644 15306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "bd492cabb46a4f478c0b1ddeac27fd0f"
format_stamp: "Formatted at 2026-08-12 11:22:17 on dist-test-slave-7kzw"
server_key: "de2b236d7166b444420f45c3b088c222"
server_key_iv: "344a093e53ed148dfebe478b67644af3"
server_key_version: "encryptionkey@0"
I20260812 11:22:17.634825 15306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:17.648360 15306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:17.652611 15306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:17.652854 15306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:17.653713 15306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:17.655076 15306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:17.655154 15306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.655241 15306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:17.655289 15306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:17.695415 15306 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:32907
I20260812 11:22:17.695458 15531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:32907 every 8 connection(s)
I20260812 11:22:17.696768 15306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:17.703405 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 15306
I20260812 11:22:17.703604 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:17.704058 16019 external_mini_cluster.cc:1428] Setting key f40109475b4c9e6e68256fe99aa2e808
Aug 12 11:22:17 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.194@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:17.720606 15536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:17.699391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:37853 (local address 127.15.164.254:41243)
0812 11:22:17.699899 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:17.699905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:17.700936 (+ 1031us) server_negotiation.cc:407] Connection header received
0812 11:22:17.703003 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:17.703010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:17.703113 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:17.703250 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:17.705173 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.706069 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.708594 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.709058 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.709166 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:17.713987 (+ 4821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:17.713992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:17.713996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:17.714029 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:17.716781 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:17.717749 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:17.717753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:17.717755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:17.717915 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:17.718495 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:17.718503 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:17.718510 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:17.718796 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:17.718916 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:17.719839 (+ 923us) server_negotiation.cc:299] Negotiation successful
0812 11:22:17.720120 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":282,"threads_started":1}
I20260812 11:22:17.721232 15537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:17.699928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41243 (local address 127.15.164.194:37853)
0812 11:22:17.700751 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:17.700798 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:17.702712 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:17.703533 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:17.703547 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:17.704208 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:17.704973 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:17.704997 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.706253 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.706259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:17.708397 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:17.708417 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:17.709300 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:17.709310 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:17.709647 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:17.710603 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:17.710639 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:17.713712 (+ 3073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:17.716941 (+ 3229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:17.716953 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:17.716975 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:17.717614 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:17.718066 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:17.718075 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:17.718081 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:17.718346 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:17.718932 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:17.718964 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:17.719429 (+ 465us) client_negotiation.cc:769] Sending connection context
0812 11:22:17.719670 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 11:22:17.720077 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":354,"threads_started":1}
I20260812 11:22:17.722851 15532 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41243
I20260812 11:22:17.723199 15532 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:17.724175 15532 heartbeater.cc:511] Master 127.15.164.254:41243 requested a full tablet report, sending...
I20260812 11:22:17.725819 14968 ts_manager.cc:194] Registered new tserver with Master: bd492cabb46a4f478c0b1ddeac27fd0f (127.15.164.194:32907)
I20260812 11:22:17.726771 14968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.194@KRBTEST.COM'} at 127.15.164.194:37853
WARNING: no policy specified for kudu/127.15.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
Entry for principal kudu/127.15.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab.
I20260812 11:22:17.773753 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:18.116488 15541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:18.116788 15541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:18.116883 15541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:18.124290 15541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:18.124392 15541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:18.124502 15541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:18.134064 15541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.195.keytab
--principal=kudu/127.15.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:41243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:18.135510 15541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:18.136795 15541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:18.150983 15547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:18.150990 15548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:18.151011 15552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:18.152437 15541 server_base.cc:1034] running on GCE node
I20260812 11:22:18.152997 15541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:18.153874 15541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:18.155119 15541 hybrid_clock.cc:648] HybridClock initialized: now 1786533738155065 us; error 46 us; skew 500 ppm
I20260812 11:22:18.155460 15541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:18 dist-test-slave-7kzw krb5kdc[14906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533738, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:18.158874 15541 init.cc:377] Logged in from keytab as kudu/127.15.164.195@KRBTEST.COM (short username kudu)
I20260812 11:22:18.160513 15541 webserver.cc:460] Webserver started at http://127.15.164.195:42413/ using document root <none> and password file <none>
I20260812 11:22:18.161216 15541 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:18.161360 15541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:18.161780 15541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:18.164815 15541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "6e107cfd4dc84a759ab0f87350afa618"
format_stamp: "Formatted at 2026-08-12 11:22:18 on dist-test-slave-7kzw"
server_key: "220c33aeef007c53b5fcd808f2d08531"
server_key_iv: "44847c841894a668a49488606817c72f"
server_key_version: "encryptionkey@0"
I20260812 11:22:18.165607 15541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "6e107cfd4dc84a759ab0f87350afa618"
format_stamp: "Formatted at 2026-08-12 11:22:18 on dist-test-slave-7kzw"
server_key: "220c33aeef007c53b5fcd808f2d08531"
server_key_iv: "44847c841894a668a49488606817c72f"
server_key_version: "encryptionkey@0"
I20260812 11:22:18.171111 15541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:22:18.174842 15574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:18.176265 15541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:18.176476 15541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "6e107cfd4dc84a759ab0f87350afa618"
format_stamp: "Formatted at 2026-08-12 11:22:18 on dist-test-slave-7kzw"
server_key: "220c33aeef007c53b5fcd808f2d08531"
server_key_iv: "44847c841894a668a49488606817c72f"
server_key_version: "encryptionkey@0"
I20260812 11:22:18.176699 15541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:18.195497 15297 heartbeater.cc:503] Master 127.15.164.254:41243 was elected leader, sending a full tablet report...
I20260812 11:22:18.197721 15541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:18.203063 15541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:18.203395 15541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:18.204547 15541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:18.206135 15541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:18.206243 15541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:18.206414 15541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:18.206516 15541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:18.242165 15541 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:42103
I20260812 11:22:18.242215 15760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:42103 every 8 connection(s)
I20260812 11:22:18.243602 15541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:18.253369 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 15541
I20260812 11:22:18.253607 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:18.254199 16019 external_mini_cluster.cc:1428] Setting key 08261984c52a56799fd6f222d8faaf1b
Aug 12 11:22:18 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533738, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.195@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:18.269505 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.246238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:49193 (local address 127.15.164.254:41243)
0812 11:22:18.246744 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.246751 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.247791 (+ 1040us) server_negotiation.cc:407] Connection header received
0812 11:22:18.249528 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.249533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.249615 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.249783 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:18.251296 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.252072 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.253633 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.254253 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.254399 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.263281 (+ 8882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:18.263286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:18.263290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:18.263325 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:18.266124 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.266902 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.266907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.266909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.267032 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.267482 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.267487 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.267490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.267797 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:18.267923 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.268830 (+ 907us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.269060 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":233,"threads_started":1}
I20260812 11:22:18.270558 15767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.246892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:41243 (local address 127.15.164.195:49193)
0812 11:22:18.247616 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.247662 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.249281 (+ 1619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.249973 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.249980 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.250590 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:18.251141 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.251159 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.252205 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.252209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.253448 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.253462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.254520 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.254530 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.254793 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.260790 (+ 5997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:22:18.260820 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:18.263045 (+ 2225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:18.266265 (+ 3220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:18.266273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:18.266286 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:18.266787 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:18.267127 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:22:18.267130 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:22:18.267133 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:22:18.267349 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:22:18.267932 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:18.267940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:18.268387 (+ 447us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.268626 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.269194 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":282,"threads_started":1}
I20260812 11:22:18.272003 15761 heartbeater.cc:347] Connected to a master server at 127.15.164.254:41243
I20260812 11:22:18.272343 15761 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:18.273123 15761 heartbeater.cc:511] Master 127.15.164.254:41243 requested a full tablet report, sending...
I20260812 11:22:18.274978 14968 ts_manager.cc:194] Registered new tserver with Master: 6e107cfd4dc84a759ab0f87350afa618 (127.15.164.195:42103)
I20260812 11:22:18.275807 14968 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.164.195@KRBTEST.COM'} at 127.15.164.195:49193
I20260812 11:22:18.281955 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:18.299808 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.286416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53434 (local address 127.15.164.254:41243)
0812 11:22:18.286732 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.286740 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.287049 (+ 309us) server_negotiation.cc:407] Connection header received
0812 11:22:18.287296 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.287301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.287379 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.287487 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:18.289016 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.289751 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.291149 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.291549 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.291695 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.294171 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:18.294180 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:18.294192 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:18.294226 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:18.296955 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.297643 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.297650 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.297653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.297792 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.298182 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.298187 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.298190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.298605 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:18.298885 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.299241 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.299474 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260812 11:22:18.303980 14968 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:18.310994 14968 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:18.348119 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.325441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43830 (local address 127.15.164.195:42103)
0812 11:22:18.339165 (+ 13724us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.339172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.339206 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:22:18.339314 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.339322 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.339613 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.339954 (+ 341us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:18.340995 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.342568 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.345839 (+ 3271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.346846 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.347052 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.347245 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.347577 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.347742 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13535,"thread_start_us":13736,"threads_started":1}
I20260812 11:22:18.348171 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.325152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:42103 (local address 127.0.0.1:43830)
0812 11:22:18.337430 (+ 12278us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.337491 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.337756 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.340293 (+ 2537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.340302 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.340333 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:18.340723 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.340739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.342779 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.342786 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.345665 (+ 2879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.345681 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.347052 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.347061 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.347305 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.347357 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.347535 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.347742 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11862,"mutex_wait_us":3,"thread_start_us":16213,"threads_started":1}
I20260812 11:22:18.349807 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.325518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:32907 (local address 127.0.0.1:39490)
0812 11:22:18.339926 (+ 14408us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.339948 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.340155 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.341080 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.341087 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.341119 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:18.341697 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.341712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.343805 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.343811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.346425 (+ 2614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.346442 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.348882 (+ 2440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.348889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.349077 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.349114 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.349232 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.349377 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14247,"mutex_wait_us":26,"thread_start_us":9760,"threads_started":1}
I20260812 11:22:18.350780 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.325674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39490 (local address 127.15.164.194:32907)
0812 11:22:18.338414 (+ 12740us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.338429 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.340038 (+ 1609us) server_negotiation.cc:407] Connection header received
0812 11:22:18.340364 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.340374 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.340593 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.340763 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:18.341898 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.343610 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.346648 (+ 3038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.348343 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.348492 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.348664 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.349324 (+ 660us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.349496 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12516,"thread_start_us":12772,"threads_started":1}
I20260812 11:22:18.351518 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.339255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:44221 (local address 127.0.0.1:33024)
0812 11:22:18.341751 (+ 2496us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.341767 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.342021 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.342678 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.342684 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.342713 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:18.343196 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.343211 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.345050 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.345057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.347589 (+ 2532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.347607 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.350596 (+ 2989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.350603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.350803 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.350838 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.351039 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.351162 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2327,"mutex_wait_us":3,"thread_start_us":334,"threads_started":1}
I20260812 11:22:18.352241 15786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.336828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.15.164.193:44221)
0812 11:22:18.339160 (+ 2332us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.339170 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.341897 (+ 2727us) server_negotiation.cc:407] Connection header received
0812 11:22:18.342224 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.342232 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.342431 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.342667 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:18.343408 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.344886 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.347816 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.350345 (+ 2529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.350589 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.350782 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.351751 (+ 969us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.351925 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2144,"thread_start_us":1953,"threads_started":1}
I20260812 11:22:18.352807 15646 tablet_service.cc:1467] Processing CreateTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 (DEFAULT_TABLE table=test-table [id=c62958f8498f478d89127bab09bb6797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:18.354446 15646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a1db58bace477fb5769ed92ddbbec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:18.354212 15413 tablet_service.cc:1467] Processing CreateTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 (DEFAULT_TABLE table=test-table [id=c62958f8498f478d89127bab09bb6797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:18.355479 15413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a1db58bace477fb5769ed92ddbbec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:18.362121 15181 tablet_service.cc:1467] Processing CreateTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 (DEFAULT_TABLE table=test-table [id=c62958f8498f478d89127bab09bb6797]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:18.363727 15181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a1db58bace477fb5769ed92ddbbec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:18.368633 15789 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Bootstrap starting.
I20260812 11:22:18.371978 15789 tablet_bootstrap.cc:654] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:18.373004 15789 log.cc:824] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:18.374001 15790 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Bootstrap starting.
I20260812 11:22:18.377579 15790 tablet_bootstrap.cc:654] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:18.377806 15789 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: No bootstrap required, opened a new log
I20260812 11:22:18.378132 15789 ts_tablet_manager.cc:1397] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260812 11:22:18.378779 15790 log.cc:824] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:18.380967 15794 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Bootstrap starting.
I20260812 11:22:18.382189 15790 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: No bootstrap required, opened a new log
I20260812 11:22:18.382509 15790 ts_tablet_manager.cc:1397] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260812 11:22:18.384891 15794 tablet_bootstrap.cc:654] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:18.386199 15794 log.cc:824] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:18.388267 15789 raft_consensus.cc:348] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.388684 15789 raft_consensus.cc:374] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:18.388826 15789 raft_consensus.cc:729] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e107cfd4dc84a759ab0f87350afa618, State: Initialized, Role: FOLLOWER
I20260812 11:22:18.389506 15789 consensus_queue.cc:260] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.390784 15761 heartbeater.cc:503] Master 127.15.164.254:41243 was elected leader, sending a full tablet report...
I20260812 11:22:18.391366 15789 ts_tablet_manager.cc:1428] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Time spent starting tablet: real 0.013s user 0.008s sys 0.006s
I20260812 11:22:18.395088 15790 raft_consensus.cc:348] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.395570 15790 raft_consensus.cc:374] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:18.395686 15790 raft_consensus.cc:729] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd492cabb46a4f478c0b1ddeac27fd0f, State: Initialized, Role: FOLLOWER
I20260812 11:22:18.396348 15790 consensus_queue.cc:260] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.397531 15532 heartbeater.cc:503] Master 127.15.164.254:41243 was elected leader, sending a full tablet report...
I20260812 11:22:18.398051 15790 ts_tablet_manager.cc:1428] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260812 11:22:18.398371 15794 tablet_bootstrap.cc:492] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: No bootstrap required, opened a new log
I20260812 11:22:18.398737 15794 ts_tablet_manager.cc:1397] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.004s
I20260812 11:22:18.407856 15794 raft_consensus.cc:348] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.408248 15794 raft_consensus.cc:374] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:18.408339 15794 raft_consensus.cc:729] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fed8a972bc8474f9b434e4845986f4f, State: Initialized, Role: FOLLOWER
I20260812 11:22:18.408869 15794 consensus_queue.cc:260] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.410333 15794 ts_tablet_manager.cc:1428] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
W20260812 11:22:18.412015 15298 tablet.cc:2369] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:18.448807 15534 tablet.cc:2369] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:18.495311 15763 tablet.cc:2369] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:18.500901 15798 raft_consensus.cc:482] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:18.501221 15798 raft_consensus.cc:504] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.503096 15798 leader_election.cc:288] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e107cfd4dc84a759ab0f87350afa618 (127.15.164.195:42103), bd492cabb46a4f478c0b1ddeac27fd0f (127.15.164.194:32907)
I20260812 11:22:18.510178 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.503592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:34187 (local address 127.15.164.194:32907)
0812 11:22:18.503914 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.503924 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.504731 (+ 807us) server_negotiation.cc:407] Connection header received
0812 11:22:18.504965 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.504969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.505030 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.505127 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:18.505804 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.506611 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.508421 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.509171 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.509353 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.509440 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.509747 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.509885 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260812 11:22:18.510192 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.503582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:47683 (local address 127.15.164.195:42103)
0812 11:22:18.503888 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.503899 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.504829 (+ 930us) server_negotiation.cc:407] Connection header received
0812 11:22:18.505038 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.505042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.505101 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.505208 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:18.505881 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.506683 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.508470 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.509213 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.509398 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.509479 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.509789 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.509928 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260812 11:22:18.510418 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.503481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:32907 (local address 127.15.164.193:34187)
0812 11:22:18.504616 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.504633 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.504813 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.505147 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.505151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.505176 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:18.505656 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.505670 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.506747 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.506753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.508261 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.508273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.509408 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.509415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.509573 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.509598 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.509719 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.509900 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":996,"mutex_wait_us":28,"spinlock_wait_cycles":24960,"thread_start_us":660,"threads_started":1}
I20260812 11:22:18.510778 15800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.503505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:42103 (local address 127.15.164.193:47683)
0812 11:22:18.504714 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:18.504729 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:18.504890 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:18.505222 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:18.505227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:18.505264 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:18.505689 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.505699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.506834 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.506843 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.508297 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:18.508310 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.509459 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.509466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:18.509615 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.509638 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:22:18.509751 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:22:18.509936 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"mutex_wait_us":46,"thread_start_us":711,"threads_started":1}
I20260812 11:22:18.511524 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a1db58bace477fb5769ed92ddbbec5" candidate_uuid: "8fed8a972bc8474f9b434e4845986f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" is_pre_election: true
I20260812 11:22:18.511719 15678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a1db58bace477fb5769ed92ddbbec5" candidate_uuid: "8fed8a972bc8474f9b434e4845986f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e107cfd4dc84a759ab0f87350afa618" is_pre_election: true
I20260812 11:22:18.512116 15446 raft_consensus.cc:2454] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fed8a972bc8474f9b434e4845986f4f in term 0.
I20260812 11:22:18.512261 15678 raft_consensus.cc:2454] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fed8a972bc8474f9b434e4845986f4f in term 0.
I20260812 11:22:18.512861 15097 leader_election.cc:302] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fed8a972bc8474f9b434e4845986f4f, bd492cabb46a4f478c0b1ddeac27fd0f; no voters:
I20260812 11:22:18.513307 15798 raft_consensus.cc:2781] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:18.513474 15798 raft_consensus.cc:482] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:18.513603 15798 raft_consensus.cc:3037] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:18.515920 15798 raft_consensus.cc:504] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.516517 15798 leader_election.cc:288] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [CANDIDATE]: Term 1 election: Requested vote from peers 6e107cfd4dc84a759ab0f87350afa618 (127.15.164.195:42103), bd492cabb46a4f478c0b1ddeac27fd0f (127.15.164.194:32907)
I20260812 11:22:18.517068 15678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a1db58bace477fb5769ed92ddbbec5" candidate_uuid: "8fed8a972bc8474f9b434e4845986f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e107cfd4dc84a759ab0f87350afa618"
I20260812 11:22:18.517097 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a1db58bace477fb5769ed92ddbbec5" candidate_uuid: "8fed8a972bc8474f9b434e4845986f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f"
I20260812 11:22:18.517304 15678 raft_consensus.cc:3037] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:18.517304 15446 raft_consensus.cc:3037] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:18.520612 15678 raft_consensus.cc:2454] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fed8a972bc8474f9b434e4845986f4f in term 1.
I20260812 11:22:18.520612 15446 raft_consensus.cc:2454] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fed8a972bc8474f9b434e4845986f4f in term 1.
I20260812 11:22:18.521082 15097 leader_election.cc:302] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fed8a972bc8474f9b434e4845986f4f, bd492cabb46a4f478c0b1ddeac27fd0f; no voters:
I20260812 11:22:18.521404 15798 raft_consensus.cc:2781] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:18.521903 15798 raft_consensus.cc:686] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 1 LEADER]: Becoming Leader. State: Replica: 8fed8a972bc8474f9b434e4845986f4f, State: Running, Role: LEADER
I20260812 11:22:18.522400 15798 consensus_queue.cc:237] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } }
I20260812 11:22:18.527362 14968 catalog_manager.cc:5495] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fed8a972bc8474f9b434e4845986f4f (127.15.164.193). New cstate: current_term: 1 leader_uuid: "8fed8a972bc8474f9b434e4845986f4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fed8a972bc8474f9b434e4845986f4f" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 44221 } health_report { overall_health: HEALTHY } } }
I20260812 11:22:18.587002 15786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.581205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33034 (local address 127.15.164.193:44221)
0812 11:22:18.581417 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.581425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.581486 (+ 61us) server_negotiation.cc:407] Connection header received
0812 11:22:18.581775 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.581780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.581863 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.582033 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:18.582439 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.583207 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.584819 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.585208 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.585344 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.585874 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:18.586386 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:18.586588 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.586643 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.586727 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:22:18.595645 15446 raft_consensus.cc:1261] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 1 FOLLOWER]: Refusing update from remote peer 8fed8a972bc8474f9b434e4845986f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:18.595638 15678 raft_consensus.cc:1261] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 1 FOLLOWER]: Refusing update from remote peer 8fed8a972bc8474f9b434e4845986f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:18.596668 15801 consensus_queue.cc:1035] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd492cabb46a4f478c0b1ddeac27fd0f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:18.597075 15798 consensus_queue.cc:1035] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e107cfd4dc84a759ab0f87350afa618" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 42103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:18.608996 15811 mvcc.cc:205] Tried to move back new op lower bound from 7317642193276817408 to 7317642192991911936. Current Snapshot: MvccSnapshot[applied={T|T < 7317642193276817408}]
I20260812 11:22:18.609112 15812 mvcc.cc:205] Tried to move back new op lower bound from 7317642193276817408 to 7317642192991911936. Current Snapshot: MvccSnapshot[applied={T|T < 7317642193276817408}]
I20260812 11:22:18.622937 14968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:18.623222 14968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:18.627144 14968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c30fe5a31db4ebe87b6fc7ed37fe1c0: Sending DeleteTablet for 3 replicas of tablet 69a1db58bace477fb5769ed92ddbbec5
I20260812 11:22:18.628502 15646 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:18 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:43830
I20260812 11:22:18.628619 15413 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:18 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:39490
I20260812 11:22:18.628885 15181 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a1db58bace477fb5769ed92ddbbec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:18 UTC) from {username='kudu', principal='kudu/127.15.164.254@KRBTEST.COM'} at 127.0.0.1:33024
I20260812 11:22:18.633322 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 15072
I20260812 11:22:18.640213 15837 tablet_replica.cc:330] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: stopping tablet replica
I20260812 11:22:18.641714 15837 raft_consensus.cc:2229] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:18.643487 15832 tablet_replica.cc:330] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: stopping tablet replica
I20260812 11:22:18.644726 15837 raft_consensus.cc:2258] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:18.645478 15832 raft_consensus.cc:2229] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:18.646600 15832 raft_consensus.cc:2258] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:18.648188 15837 ts_tablet_manager.cc:1905] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:18.649161 15832 ts_tablet_manager.cc:1905] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:18.656951 15832 ts_tablet_manager.cc:1918] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:18.657272 15832 log.cc:1196] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/69a1db58bace477fb5769ed92ddbbec5
I20260812 11:22:18.658036 15832 ts_tablet_manager.cc:1939] T 69a1db58bace477fb5769ed92ddbbec5 P bd492cabb46a4f478c0b1ddeac27fd0f: Deleting consensus metadata
Aug 12 11:22:18 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.193@KRBTEST.COM
I20260812 11:22:18.660411 15830 tablet_replica.cc:330] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: stopping tablet replica
I20260812 11:22:18.660579 15837 ts_tablet_manager.cc:1918] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:18.660801 15837 log.cc:1196] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-0/wal/wals/69a1db58bace477fb5769ed92ddbbec5
I20260812 11:22:18.660712 14947 catalog_manager.cc:4841] TS bd492cabb46a4f478c0b1ddeac27fd0f (127.15.164.194:32907): tablet 69a1db58bace477fb5769ed92ddbbec5 (table test-table [id=c62958f8498f478d89127bab09bb6797]) successfully deleted
I20260812 11:22:18.660965 15830 raft_consensus.cc:2229] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:18.661361 15837 ts_tablet_manager.cc:1939] T 69a1db58bace477fb5769ed92ddbbec5 P 8fed8a972bc8474f9b434e4845986f4f: Deleting consensus metadata
I20260812 11:22:18.661579 15830 raft_consensus.cc:2258] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:18.663265 14947 catalog_manager.cc:4841] TS 8fed8a972bc8474f9b434e4845986f4f (127.15.164.193:44221): tablet 69a1db58bace477fb5769ed92ddbbec5 (table test-table [id=c62958f8498f478d89127bab09bb6797]) successfully deleted
I20260812 11:22:18.664113 15830 ts_tablet_manager.cc:1905] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:18.670295 15830 ts_tablet_manager.cc:1918] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:18.670531 15830 log.cc:1196] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/69a1db58bace477fb5769ed92ddbbec5
I20260812 11:22:18.671175 15830 ts_tablet_manager.cc:1939] T 69a1db58bace477fb5769ed92ddbbec5 P 6e107cfd4dc84a759ab0f87350afa618: Deleting consensus metadata
I20260812 11:22:18.672791 15786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.634337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.15.164.193:44221)
0812 11:22:18.634593 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.634603 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.647305 (+ 12702us) server_negotiation.cc:407] Connection header received
0812 11:22:18.647857 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.647863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.647964 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.648073 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:18.650293 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.651670 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.653695 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.654562 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.654683 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.664043 (+ 9360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:18.664060 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:18.664078 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:18.664130 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:18.668534 (+ 4404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.669575 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.669585 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.669589 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.669795 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.670330 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.670336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.670339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.670987 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:18.671354 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.671822 (+ 468us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.672114 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:22:18.673352 14946 catalog_manager.cc:4841] TS 6e107cfd4dc84a759ab0f87350afa618 (127.15.164.195:42103): tablet 69a1db58bace477fb5769ed92ddbbec5 (table test-table [id=c62958f8498f478d89127bab09bb6797]) successfully deleted
I20260812 11:22:18.673636 15289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:18.788715 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 15072
I20260812 11:22:18.817171 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 15306
Aug 12 11:22:18 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.194@KRBTEST.COM
I20260812 11:22:18.834327 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.818087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39502 (local address 127.15.164.194:32907)
0812 11:22:18.818303 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.818311 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.818336 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:22:18.818611 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.818616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.818688 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.818819 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:18.820244 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.821066 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.822647 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.823078 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.823238 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.828028 (+ 4790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:18.828043 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:18.828061 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:18.828104 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:18.831390 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.832110 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.832119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.832122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.832272 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.832688 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.832692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.832694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.833099 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:18.833442 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.833763 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.833993 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:22:18.835080 15524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:18.925940 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 15306
I20260812 11:22:18.951318 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 15541
Aug 12 11:22:18 dist-test-slave-7kzw krb5kdc[14906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.195@KRBTEST.COM
I20260812 11:22:18.968039 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:18.952358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43842 (local address 127.15.164.195:42103)
0812 11:22:18.952555 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:18.952564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:18.952586 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:18.952761 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:18.952767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:18.952852 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:18.952944 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:18.954460 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.955281 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.956656 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:18.957093 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:18.957224 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:18.962610 (+ 5386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:18.962627 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:18.962646 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:18.962684 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:18.965285 (+ 2601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.966050 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.966057 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.966060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.966206 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:18.966586 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:18.966589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:18.966591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:18.966930 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:18.967154 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:18.967491 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 11:22:18.967659 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:22:18.968722 15756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:19.058852 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 15541
I20260812 11:22:19.082294 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 14924
I20260812 11:22:19.083570 15026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:19.196393 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 14924
2026-08-12T11:22:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4918 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T11:22:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:19Z Disabled control of system clock
I20260812 11:22:19.304971 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:34475
--webserver_interface=127.15.164.254
--webserver_port=0
--builtin_ntp_servers=127.15.164.212:36383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:34475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:19.666675 15851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:19.667089 15851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:19.667261 15851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:19.675937 15851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:19.676041 15851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:19.676080 15851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:19.676138 15851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:19.676190 15851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:19.686662 15851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:34475
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:34475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:19.688021 15851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:19.689836 15851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:19.702047 15863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:19.702178 15859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:19.702178 15860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:19.703703 15851 server_base.cc:1034] running on GCE node
I20260812 11:22:19.704545 15851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:19.706106 15851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:19.707362 15851 hybrid_clock.cc:648] HybridClock initialized: now 1786533739707281 us; error 66 us; skew 500 ppm
I20260812 11:22:19.707834 15851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:19.710594 15851 webserver.cc:460] Webserver started at http://127.15.164.254:35487/ using document root <none> and password file <none>
I20260812 11:22:19.711390 15851 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:19.711529 15851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:19.711931 15851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:19.715345 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb"
format_stamp: "Formatted at 2026-08-12 11:22:19 on dist-test-slave-7kzw"
server_key: "151531168061e11a1dda180b6d578524"
server_key_iv: "210fd034e6b4861f6bca1d7e35bb234a"
server_key_version: "encryptionkey@0"
I20260812 11:22:19.716286 15851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb"
format_stamp: "Formatted at 2026-08-12 11:22:19 on dist-test-slave-7kzw"
server_key: "151531168061e11a1dda180b6d578524"
server_key_iv: "210fd034e6b4861f6bca1d7e35bb234a"
server_key_version: "encryptionkey@0"
I20260812 11:22:19.722105 15851 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:22:19.726017 15875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:19.727651 15851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:19.727900 15851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb"
format_stamp: "Formatted at 2026-08-12 11:22:19 on dist-test-slave-7kzw"
server_key: "151531168061e11a1dda180b6d578524"
server_key_iv: "210fd034e6b4861f6bca1d7e35bb234a"
server_key_version: "encryptionkey@0"
I20260812 11:22:19.728149 15851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:19.760563 15851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:19.761565 15851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:19.761901 15851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:19.782303 15851 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:34475
I20260812 11:22:19.782349 15967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:34475 every 8 connection(s)
I20260812 11:22:19.783839 15851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:19.787925 15969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:19.789279 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 15851
I20260812 11:22:19.789489 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:19.790099 16019 external_mini_cluster.cc:1428] Setting key 3f3f1b3caa4bcb3037f03221477daf0e
I20260812 11:22:19.802140 15969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: Bootstrap starting.
I20260812 11:22:19.805334 15975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:19.792312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.15.164.254:34475)
0812 11:22:19.793621 (+ 1309us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:19.793676 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:19.793728 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:22:19.795624 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:19.795660 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:19.796180 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:19.796655 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:19.797263 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:19.798750 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:19.800308 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:19.801092 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:19.801322 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:19.802768 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:19.802777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:19.802793 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:19.803397 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:19.803488 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:19.803513 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:19.803697 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:19.803905 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 11:22:19.804258 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":833,"thread_start_us":560,"threads_started":1}
I20260812 11:22:19.805783 15969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:19.807020 15969 log.cc:824] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:19.810207 15969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: No bootstrap required, opened a new log
I20260812 11:22:19.818106 15969 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } }
I20260812 11:22:19.818526 15969 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:19.818630 15969 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebf6ddf0ccb0482fa06f10ce3c8c12cb, State: Initialized, Role: FOLLOWER
I20260812 11:22:19.819247 15969 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } }
I20260812 11:22:19.819499 15969 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:19.819605 15969 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:19.819806 15969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:19.822324 15969 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } }
I20260812 11:22:19.822942 15969 leader_election.cc:302] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebf6ddf0ccb0482fa06f10ce3c8c12cb; no voters:
I20260812 11:22:19.823657 15969 leader_election.cc:288] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:19.823894 15978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:19.824717 15978 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [term 1 LEADER]: Becoming Leader. State: Replica: ebf6ddf0ccb0482fa06f10ce3c8c12cb, State: Running, Role: LEADER
I20260812 11:22:19.825232 15978 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } }
I20260812 11:22:19.826009 15969 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:19.828213 15981 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebf6ddf0ccb0482fa06f10ce3c8c12cb. Latest consensus state: current_term: 1 leader_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } } }
I20260812 11:22:19.828622 15981 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:19.829584 15980 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf6ddf0ccb0482fa06f10ce3c8c12cb" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34475 } } }
I20260812 11:22:19.829953 15980 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:19.831583 15987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:19.837749 15987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:19.850176 15987 catalog_manager.cc:1347] Generated new cluster ID: 5a8df295661e4be0b6c1ba29165af8f4
I20260812 11:22:19.850320 15987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:19.861625 15987 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:19.863235 15987 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:19.875098 15987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: Generated new TSK 0
I20260812 11:22:19.876071 15987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:19.883738 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.193:0
--local_ip_for_outbound_sockets=127.15.164.193
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--builtin_ntp_servers=127.15.164.212:36383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:22:20.281711 16011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:20.282060 16011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:20.282160 16011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:20.289541 16011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:20.289667 16011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:20.289783 16011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.193
I20260812 11:22:20.299285 16011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.164.193
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.193
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:20.300634 16011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:20.302562 16011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:20.317142 16029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:20.317126 16032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:20.317037 16030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:20.318096 16011 server_base.cc:1034] running on GCE node
I20260812 11:22:20.318930 16011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:20.320111 16011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:20.321358 16011 hybrid_clock.cc:648] HybridClock initialized: now 1786533740321310 us; error 32 us; skew 500 ppm
I20260812 11:22:20.321803 16011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:20.324646 16011 webserver.cc:460] Webserver started at http://127.15.164.193:39745/ using document root <none> and password file <none>
I20260812 11:22:20.325382 16011 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:20.325480 16011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:20.325810 16011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:20.329370 16011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data/instance:
uuid: "be247249f8de4330ac8adcdf88d8d30b"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "77346894caf8a8dc9494cb49e81ad25f"
server_key_iv: "ea90b4af266e3ac679dc4d94f11df45c"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.330330 16011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance:
uuid: "be247249f8de4330ac8adcdf88d8d30b"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "77346894caf8a8dc9494cb49e81ad25f"
server_key_iv: "ea90b4af266e3ac679dc4d94f11df45c"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.336722 16011 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:22:20.340780 16041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.342274 16011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:20.342535 16011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal
uuid: "be247249f8de4330ac8adcdf88d8d30b"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "77346894caf8a8dc9494cb49e81ad25f"
server_key_iv: "ea90b4af266e3ac679dc4d94f11df45c"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.342823 16011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:20.358458 16011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:20.359481 16011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:20.359846 16011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:20.360956 16011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:20.362759 16011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:20.362895 16011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.363054 16011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:20.363155 16011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.401238 16011 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.193:45699
I20260812 11:22:20.401309 16245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.193:45699 every 8 connection(s)
I20260812 11:22:20.402801 16011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/data/info.pb
I20260812 11:22:20.403309 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16011
I20260812 11:22:20.403517 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-0/wal/instance
I20260812 11:22:20.404206 16019 external_mini_cluster.cc:1428] Setting key 5d1e42bee0d282f6bebee163c230f875
I20260812 11:22:20.407969 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.194:0
--local_ip_for_outbound_sockets=127.15.164.194
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--builtin_ntp_servers=127.15.164.212:36383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:20.420518 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:20.405941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.193:42683 (local address 127.15.164.254:34475)
0812 11:22:20.406456 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:20.406483 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:20.408368 (+ 1885us) server_negotiation.cc:407] Connection header received
0812 11:22:20.411549 (+ 3181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:20.411554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:20.411650 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:20.411758 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:20.413322 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.414090 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.416912 (+ 2822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.417356 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.417510 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:20.419446 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:20.419454 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:20.419462 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:20.419488 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:20.419543 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:20.419561 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:20.419654 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:20.419967 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 11:22:20.420084 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":272,"threads_started":1}
I20260812 11:22:20.422118 16250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:20.406829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:34475 (local address 127.15.164.193:42683)
0812 11:22:20.408080 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:20.408149 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:20.411184 (+ 3035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:20.412060 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:20.412075 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:20.412217 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:20.413098 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:20.413130 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.414279 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.414288 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:20.416724 (+ 2436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:20.416746 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.417626 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.417637 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:20.418005 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:20.418985 (+ 980us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:20.418991 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:20.419067 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:20.419199 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:20.419680 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:20.419697 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:20.419710 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 11:22:20.419921 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 11:22:20.420433 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":380,"threads_started":1}
I20260812 11:22:20.424044 16246 heartbeater.cc:347] Connected to a master server at 127.15.164.254:34475
I20260812 11:22:20.424400 16246 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:20.425236 16246 heartbeater.cc:511] Master 127.15.164.254:34475 requested a full tablet report, sending...
I20260812 11:22:20.427850 15906 ts_manager.cc:194] Registered new tserver with Master: be247249f8de4330ac8adcdf88d8d30b (127.15.164.193:45699)
I20260812 11:22:20.430130 15906 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.193:42683
W20260812 11:22:20.765800 16251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:20.766078 16251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:20.766167 16251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:20.773576 16251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:20.773680 16251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:20.773787 16251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.194
I20260812 11:22:20.783128 16251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.164.194
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.194
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:20.784404 16251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:20.786149 16251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:20.800897 16257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:20.800953 16258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:20.801026 16261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:20.801894 16251 server_base.cc:1034] running on GCE node
I20260812 11:22:20.802588 16251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:20.803588 16251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:20.804853 16251 hybrid_clock.cc:648] HybridClock initialized: now 1786533740804779 us; error 46 us; skew 500 ppm
I20260812 11:22:20.805249 16251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:20.807865 16251 webserver.cc:460] Webserver started at http://127.15.164.194:37245/ using document root <none> and password file <none>
I20260812 11:22:20.808692 16251 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:20.808830 16251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:20.809216 16251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:20.812453 16251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data/instance:
uuid: "c5baced98daa48d4b91f0d5ca068774f"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "fd45612a30f4bc5b8af4304e916526be"
server_key_iv: "f718ab5e0a4d9388d5c59de466d749f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.813373 16251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance:
uuid: "c5baced98daa48d4b91f0d5ca068774f"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "fd45612a30f4bc5b8af4304e916526be"
server_key_iv: "f718ab5e0a4d9388d5c59de466d749f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.819100 16251 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:22:20.822649 16273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.824108 16251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:20.824285 16251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal
uuid: "c5baced98daa48d4b91f0d5ca068774f"
format_stamp: "Formatted at 2026-08-12 11:22:20 on dist-test-slave-7kzw"
server_key: "fd45612a30f4bc5b8af4304e916526be"
server_key_iv: "f718ab5e0a4d9388d5c59de466d749f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:20.824501 16251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:20.848929 16251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:20.849857 16251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:20.850205 16251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:20.851297 16251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:20.852931 16251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:20.853060 16251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.853204 16251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:20.853298 16251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:20.888309 16251 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.194:43849
I20260812 11:22:20.888404 16458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.194:43849 every 8 connection(s)
I20260812 11:22:20.889688 16251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/data/info.pb
I20260812 11:22:20.896739 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16251
I20260812 11:22:20.896922 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal/instance
I20260812 11:22:20.897397 16019 external_mini_cluster.cc:1428] Setting key d76f4b001ade9671a0de1a64bb4f0c94
I20260812 11:22:20.900430 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.164.195:0
--local_ip_for_outbound_sockets=127.15.164.195
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--builtin_ntp_servers=127.15.164.212:36383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:22:20.903252 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:20.892508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.194:46769 (local address 127.15.164.254:34475)
0812 11:22:20.892701 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:20.892705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:20.894018 (+ 1313us) server_negotiation.cc:407] Connection header received
0812 11:22:20.895885 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:20.895891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:20.895982 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:20.896107 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:20.897254 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.898129 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.900182 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.900619 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.900745 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:20.902248 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:20.902258 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:20.902267 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:20.902292 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:20.902340 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:20.902361 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:20.902493 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:20.902737 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 11:22:20.902853 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:22:20.904112 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:20.892956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:34475 (local address 127.15.164.194:46769)
0812 11:22:20.893866 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:20.893900 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:20.895613 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:20.896326 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:20.896333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:20.896439 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:20.897086 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:20.897105 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.898308 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.898313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:20.900022 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:20.900035 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:20.900952 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:20.900956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:20.901160 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:20.901916 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:20.901918 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:20.901958 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:20.902038 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:20.902518 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:20.902535 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:20.902541 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:22:20.902689 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:22:20.903025 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":285,"threads_started":1}
I20260812 11:22:20.905747 16460 heartbeater.cc:347] Connected to a master server at 127.15.164.254:34475
I20260812 11:22:20.906095 16460 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:20.906981 16460 heartbeater.cc:511] Master 127.15.164.254:34475 requested a full tablet report, sending...
I20260812 11:22:20.908650 15906 ts_manager.cc:194] Registered new tserver with Master: c5baced98daa48d4b91f0d5ca068774f (127.15.164.194:43849)
I20260812 11:22:20.909508 15906 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.194:46769
W20260812 11:22:21.246711 16463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:21.247033 16463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:21.247125 16463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:21.254580 16463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:21.254685 16463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:21.254791 16463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.164.195
I20260812 11:22:21.263816 16463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:36383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.164.195
--webserver_port=0
--tserver_master_addrs=127.15.164.254:34475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.164.195
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:21.265105 16463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:21.266932 16463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:21.280673 16481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:21.280716 16484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:21.280630 16482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:21.281931 16463 server_base.cc:1034] running on GCE node
I20260812 11:22:21.282738 16463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:21.283809 16463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:21.285070 16463 hybrid_clock.cc:648] HybridClock initialized: now 1786533741285016 us; error 42 us; skew 500 ppm
I20260812 11:22:21.285421 16463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:22:21.287976 16463 webserver.cc:460] Webserver started at http://127.15.164.195:40725/ using document root <none> and password file <none>
I20260812 11:22:21.288756 16463 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:21.288909 16463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:21.289265 16463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:21.292394 16463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data/instance:
uuid: "2f2b21554dde492a8bd3125b2b28db9f"
format_stamp: "Formatted at 2026-08-12 11:22:21 on dist-test-slave-7kzw"
server_key: "0f66385545addd0914a7fdf09e8ce67a"
server_key_iv: "f83b5bee2cd87e3b49822e2ea7166ef9"
server_key_version: "encryptionkey@0"
I20260812 11:22:21.293217 16463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance:
uuid: "2f2b21554dde492a8bd3125b2b28db9f"
format_stamp: "Formatted at 2026-08-12 11:22:21 on dist-test-slave-7kzw"
server_key: "0f66385545addd0914a7fdf09e8ce67a"
server_key_iv: "f83b5bee2cd87e3b49822e2ea7166ef9"
server_key_version: "encryptionkey@0"
I20260812 11:22:21.298629 16463 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 11:22:21.302744 16493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:21.304124 16463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:21.304344 16463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal
uuid: "2f2b21554dde492a8bd3125b2b28db9f"
format_stamp: "Formatted at 2026-08-12 11:22:21 on dist-test-slave-7kzw"
server_key: "0f66385545addd0914a7fdf09e8ce67a"
server_key_iv: "f83b5bee2cd87e3b49822e2ea7166ef9"
server_key_version: "encryptionkey@0"
I20260812 11:22:21.304577 16463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:21.324749 16463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:21.325598 16463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:21.325991 16463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:21.327145 16463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:22:21.328812 16463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:22:21.328943 16463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:21.329075 16463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:22:21.329173 16463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:21.362790 16463 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.195:41325
I20260812 11:22:21.362880 16668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.195:41325 every 8 connection(s)
I20260812 11:22:21.364143 16463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/data/info.pb
I20260812 11:22:21.373124 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16463
I20260812 11:22:21.373332 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal/instance
I20260812 11:22:21.373808 16019 external_mini_cluster.cc:1428] Setting key 254c127f6f87f7233e8dd7dab4a6cc50
I20260812 11:22:21.377230 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.366995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:40861 (local address 127.15.164.254:34475)
0812 11:22:21.367215 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.367220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.368591 (+ 1371us) server_negotiation.cc:407] Connection header received
0812 11:22:21.370280 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.370284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.370365 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.370458 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:21.371536 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.372309 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.374079 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.374630 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.374780 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.376350 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:21.376355 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:21.376358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:21.376375 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:21.376407 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:21.376420 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:21.376523 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.376767 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.376866 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 11:22:21.378167 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.367498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:34475 (local address 127.15.164.195:40861)
0812 11:22:21.368430 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.368478 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.370013 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.370715 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.370723 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.370805 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:22:21.371367 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.371384 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.372433 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.372437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.373918 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.373934 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.374873 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.374881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.375161 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.375957 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:22:21.375960 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:22:21.375997 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:22:21.376133 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:22:21.376524 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:22:21.376538 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:22:21.376548 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.376753 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.377149 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":302,"threads_started":1}
I20260812 11:22:21.379441 16669 heartbeater.cc:347] Connected to a master server at 127.15.164.254:34475
I20260812 11:22:21.379748 16669 heartbeater.cc:464] Registering TS with master...
I20260812 11:22:21.380519 16669 heartbeater.cc:511] Master 127.15.164.254:34475 requested a full tablet report, sending...
I20260812 11:22:21.381922 15906 ts_manager.cc:194] Registered new tserver with Master: 2f2b21554dde492a8bd3125b2b28db9f (127.15.164.195:41325)
I20260812 11:22:21.382766 15906 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.164.195:40861
I20260812 11:22:21.389082 16019 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:22:21.399566 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.393347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57796 (local address 127.15.164.254:34475)
0812 11:22:21.393577 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.393587 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.394029 (+ 442us) server_negotiation.cc:407] Connection header received
0812 11:22:21.394170 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.394175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.394288 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.394416 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:21.394933 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.395714 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.397087 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.397492 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.397594 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.398784 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:21.398788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:21.398791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:21.398809 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:21.398857 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:21.398870 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:21.398947 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.399114 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.399257 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:22:21.403581 15906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:22:21.410722 15906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:22:21.434115 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.423281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.15.164.193:45699)
0812 11:22:21.424351 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.424362 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.424395 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:22:21.424501 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.424507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.424815 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.425016 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:21.426161 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.428396 (+ 2235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.431152 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.432799 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.433006 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.433244 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.433549 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.433738 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":761,"threads_started":1}
I20260812 11:22:21.434005 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.423167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53302)
0812 11:22:21.424008 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.424055 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.424251 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.425217 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.425228 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.425270 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:21.425793 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.425806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.428536 (+ 2730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.428542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.430939 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.430958 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.433038 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.433044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.433249 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.433306 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.433453 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.433652 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":371,"threads_started":1}
I20260812 11:22:21.434497 16246 heartbeater.cc:503] Master 127.15.164.254:34475 was elected leader, sending a full tablet report...
I20260812 11:22:21.436425 16691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.424485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.195:41325 (local address 127.0.0.1:36094)
0812 11:22:21.426097 (+ 1612us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.426116 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.426245 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.427183 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.427187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.427215 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:21.427718 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.427734 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.429952 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.429958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.432537 (+ 2579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.432554 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.434613 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.434621 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.434815 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.434846 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.434927 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.435052 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1496,"mutex_wait_us":1,"thread_start_us":1294,"threads_started":1}
I20260812 11:22:21.436852 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.426994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:43849 (local address 127.0.0.1:49382)
0812 11:22:21.427718 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.427736 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.427852 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.428951 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.428956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.428982 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:21.429436 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.429450 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.431336 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.431341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.433486 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.433502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.435820 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.435826 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.436022 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.436055 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.436143 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.436275 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":411,"threads_started":1}
I20260812 11:22:21.437077 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.426403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49382 (local address 127.15.164.194:43849)
0812 11:22:21.428403 (+ 2000us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.428412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.428441 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:22:21.428536 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.428543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.428746 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.428936 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:21.429623 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.431189 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.433725 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.435572 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.435762 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.435954 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.436527 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.436706 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1816,"thread_start_us":1704,"threads_started":1}
I20260812 11:22:21.437623 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.424822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36094 (local address 127.15.164.195:41325)
0812 11:22:21.425822 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.425830 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.426393 (+ 563us) server_negotiation.cc:407] Connection header received
0812 11:22:21.426524 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.426533 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.426786 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.426991 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:21.427963 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.429521 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.432803 (+ 3282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.434321 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.436842 (+ 2521us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.437071 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.437146 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.437322 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":791,"thread_start_us":630,"threads_started":1}
I20260812 11:22:21.439502 16131 tablet_service.cc:1467] Processing CreateTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 (DEFAULT_TABLE table=test-table [id=f310a88f103d40df9fffa72a763d45a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:21.441269 16131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb67dcbf89dc4263bde7b34baebe2d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:21.441057 16355 tablet_service.cc:1467] Processing CreateTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 (DEFAULT_TABLE table=test-table [id=f310a88f103d40df9fffa72a763d45a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:21.441349 16571 tablet_service.cc:1467] Processing CreateTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 (DEFAULT_TABLE table=test-table [id=f310a88f103d40df9fffa72a763d45a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:22:21.442307 16355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb67dcbf89dc4263bde7b34baebe2d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:21.442803 16571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb67dcbf89dc4263bde7b34baebe2d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:21.454731 16698 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Bootstrap starting.
I20260812 11:22:21.456755 16699 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Bootstrap starting.
I20260812 11:22:21.458410 16700 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Bootstrap starting.
I20260812 11:22:21.458738 16698 tablet_bootstrap.cc:654] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:21.460114 16698 log.cc:824] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:21.460343 16699 tablet_bootstrap.cc:654] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:21.461436 16699 log.cc:824] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:21.461563 16700 tablet_bootstrap.cc:654] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:21.462783 16700 log.cc:824] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:21.464368 16698 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: No bootstrap required, opened a new log
I20260812 11:22:21.464722 16698 ts_tablet_manager.cc:1397] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 11:22:21.465651 16700 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: No bootstrap required, opened a new log
I20260812 11:22:21.465915 16700 ts_tablet_manager.cc:1397] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 11:22:21.466020 16699 tablet_bootstrap.cc:492] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: No bootstrap required, opened a new log
I20260812 11:22:21.466311 16699 ts_tablet_manager.cc:1397] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260812 11:22:21.473057 16700 raft_consensus.cc:348] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.473806 16700 raft_consensus.cc:374] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:21.473992 16700 raft_consensus.cc:729] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f2b21554dde492a8bd3125b2b28db9f, State: Initialized, Role: FOLLOWER
I20260812 11:22:21.474732 16700 consensus_queue.cc:260] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.475858 16669 heartbeater.cc:503] Master 127.15.164.254:34475 was elected leader, sending a full tablet report...
I20260812 11:22:21.475651 16698 raft_consensus.cc:348] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.476097 16698 raft_consensus.cc:374] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:21.476195 16698 raft_consensus.cc:729] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5baced98daa48d4b91f0d5ca068774f, State: Initialized, Role: FOLLOWER
I20260812 11:22:21.476964 16698 consensus_queue.cc:260] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.477180 16700 ts_tablet_manager.cc:1428] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 11:22:21.478188 16460 heartbeater.cc:503] Master 127.15.164.254:34475 was elected leader, sending a full tablet report...
I20260812 11:22:21.477941 16699 raft_consensus.cc:348] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.478364 16699 raft_consensus.cc:374] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:21.478569 16699 raft_consensus.cc:729] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be247249f8de4330ac8adcdf88d8d30b, State: Initialized, Role: FOLLOWER
I20260812 11:22:21.478973 16698 ts_tablet_manager.cc:1428] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
I20260812 11:22:21.479351 16699 consensus_queue.cc:260] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.481261 16699 ts_tablet_manager.cc:1428] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
W20260812 11:22:21.616008 16670 tablet.cc:2369] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:21.642063 16461 tablet.cc:2369] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:22:21.655588 16247 tablet.cc:2369] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:22:21.677698 16705 raft_consensus.cc:482] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:22:21.678056 16705 raft_consensus.cc:504] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.679934 16705 leader_election.cc:288] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be247249f8de4330ac8adcdf88d8d30b (127.15.164.193:45699), c5baced98daa48d4b91f0d5ca068774f (127.15.164.194:43849)
I20260812 11:22:21.686028 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.680308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.15.164.195:49773)
0812 11:22:21.680520 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.680545 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.680686 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.681068 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.681072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.681100 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:21.681397 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.681416 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.682489 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.682496 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.684248 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.684264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.685381 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.685391 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.685512 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.685536 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.685607 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.685704 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":3}
I20260812 11:22:21.686053 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.680450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:49773 (local address 127.15.164.193:45699)
0812 11:22:21.680670 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.680676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.680698 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:21.680843 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.680847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.680922 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.681027 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:21.681618 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.682330 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.684420 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.685219 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.685405 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.685481 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.685661 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.685814 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:22:21.687817 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.680984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.164.195:59259 (local address 127.15.164.194:43849)
0812 11:22:21.681259 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.681267 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.681781 (+ 514us) server_negotiation.cc:407] Connection header received
0812 11:22:21.681975 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.681979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.682050 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.682151 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:22:21.682829 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.683482 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.685382 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.686607 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.686780 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.686842 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.687406 (+ 564us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.687535 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 11:22:21.687706 16167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb67dcbf89dc4263bde7b34baebe2d57" candidate_uuid: "2f2b21554dde492a8bd3125b2b28db9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be247249f8de4330ac8adcdf88d8d30b" is_pre_election: true
I20260812 11:22:21.688324 16167 raft_consensus.cc:2454] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f2b21554dde492a8bd3125b2b28db9f in term 0.
I20260812 11:22:21.688515 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.680801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.194:43849 (local address 127.15.164.195:59259)
0812 11:22:21.681657 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.681675 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:22:21.681829 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:22:21.682164 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:22:21.682169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:22:21.682194 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:22:21.682623 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.682634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.683649 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.683654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.685184 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:22:21.685197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.686955 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.686961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:22:21.687173 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.687218 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:22:21.688019 (+ 801us) client_negotiation.cc:240] Negotiation successful
0812 11:22:21.688156 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":1,"thread_start_us":503,"threads_started":1}
I20260812 11:22:21.689100 16496 leader_election.cc:302] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2b21554dde492a8bd3125b2b28db9f, be247249f8de4330ac8adcdf88d8d30b; no voters:
I20260812 11:22:21.689497 16705 raft_consensus.cc:2781] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:22:21.689620 16705 raft_consensus.cc:482] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:22:21.689756 16705 raft_consensus.cc:3037] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:21.689510 16396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb67dcbf89dc4263bde7b34baebe2d57" candidate_uuid: "2f2b21554dde492a8bd3125b2b28db9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5baced98daa48d4b91f0d5ca068774f" is_pre_election: true
I20260812 11:22:21.690073 16396 raft_consensus.cc:2454] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f2b21554dde492a8bd3125b2b28db9f in term 0.
I20260812 11:22:21.692278 16705 raft_consensus.cc:504] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.692973 16705 leader_election.cc:288] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [CANDIDATE]: Term 1 election: Requested vote from peers be247249f8de4330ac8adcdf88d8d30b (127.15.164.193:45699), c5baced98daa48d4b91f0d5ca068774f (127.15.164.194:43849)
I20260812 11:22:21.693406 16167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb67dcbf89dc4263bde7b34baebe2d57" candidate_uuid: "2f2b21554dde492a8bd3125b2b28db9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be247249f8de4330ac8adcdf88d8d30b"
I20260812 11:22:21.693475 16396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb67dcbf89dc4263bde7b34baebe2d57" candidate_uuid: "2f2b21554dde492a8bd3125b2b28db9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5baced98daa48d4b91f0d5ca068774f"
I20260812 11:22:21.693593 16167 raft_consensus.cc:3037] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:21.693723 16396 raft_consensus.cc:3037] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:21.695925 16167 raft_consensus.cc:2454] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f2b21554dde492a8bd3125b2b28db9f in term 1.
I20260812 11:22:21.696134 16396 raft_consensus.cc:2454] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f2b21554dde492a8bd3125b2b28db9f in term 1.
I20260812 11:22:21.696427 16496 leader_election.cc:302] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f2b21554dde492a8bd3125b2b28db9f, be247249f8de4330ac8adcdf88d8d30b; no voters:
I20260812 11:22:21.696718 16705 raft_consensus.cc:2781] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:21.697247 16705 raft_consensus.cc:686] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 1 LEADER]: Becoming Leader. State: Replica: 2f2b21554dde492a8bd3125b2b28db9f, State: Running, Role: LEADER
I20260812 11:22:21.697741 16705 consensus_queue.cc:237] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } }
I20260812 11:22:21.703342 15903 catalog_manager.cc:5495] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f2b21554dde492a8bd3125b2b28db9f (127.15.164.195). New cstate: current_term: 1 leader_uuid: "2f2b21554dde492a8bd3125b2b28db9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f2b21554dde492a8bd3125b2b28db9f" member_type: VOTER last_known_addr { host: "127.15.164.195" port: 41325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 } health_report { overall_health: UNKNOWN } } }
I20260812 11:22:21.731513 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.725644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36096 (local address 127.15.164.195:41325)
0812 11:22:21.725913 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.725921 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.725945 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:22:21.726234 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.726243 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.726378 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.726571 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:22:21.726988 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.727814 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.729358 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.729768 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.729909 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.730393 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:22:21.730922 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:22:21.731086 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.731167 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.731246 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 11:22:21.740309 16396 raft_consensus.cc:1261] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 1 FOLLOWER]: Refusing update from remote peer 2f2b21554dde492a8bd3125b2b28db9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:21.740443 16167 raft_consensus.cc:1261] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b [term 1 FOLLOWER]: Refusing update from remote peer 2f2b21554dde492a8bd3125b2b28db9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:22:21.741288 16712 consensus_queue.cc:1035] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5baced98daa48d4b91f0d5ca068774f" member_type: VOTER last_known_addr { host: "127.15.164.194" port: 43849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:21.741698 16705 consensus_queue.cc:1035] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "be247249f8de4330ac8adcdf88d8d30b" member_type: VOTER last_known_addr { host: "127.15.164.193" port: 45699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:22:21.766543 15906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:21.766875 15906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:22:21.770744 15906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ebf6ddf0ccb0482fa06f10ce3c8c12cb: Sending DeleteTablet for 3 replicas of tablet bb67dcbf89dc4263bde7b34baebe2d57
I20260812 11:22:21.771943 16131 tablet_service.cc:1514] Processing DeleteTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:21 UTC) from {username='slave'} at 127.0.0.1:53302
I20260812 11:22:21.772279 16571 tablet_service.cc:1514] Processing DeleteTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:21 UTC) from {username='slave'} at 127.0.0.1:36094
I20260812 11:22:21.772917 16355 tablet_service.cc:1514] Processing DeleteTablet for tablet bb67dcbf89dc4263bde7b34baebe2d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:22:21 UTC) from {username='slave'} at 127.0.0.1:49382
I20260812 11:22:21.773213 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16011
I20260812 11:22:21.797910 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.775825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.15.164.193:45699)
0812 11:22:21.776060 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.776069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.785788 (+ 9719us) server_negotiation.cc:407] Connection header received
0812 11:22:21.786382 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.786392 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.786568 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.786668 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:21.787617 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.789212 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.791841 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.792786 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.792913 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.794962 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:21.794979 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:21.795008 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:21.796112 (+ 1104us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:21.796207 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:21.796243 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:21.796354 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.797173 (+ 819us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.797358 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:22:21.799566 16238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:21.811630 16736 tablet_replica.cc:330] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: stopping tablet replica
I20260812 11:22:21.812345 16736 raft_consensus.cc:2229] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:22:21.818989 16734 tablet_replica.cc:330] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: stopping tablet replica
I20260812 11:22:21.819664 16736 raft_consensus.cc:2258] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:21.820215 16734 raft_consensus.cc:2229] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:22:21.820945 16734 raft_consensus.cc:2258] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:22:21.823690 16736 ts_tablet_manager.cc:1905] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:21.823880 16734 ts_tablet_manager.cc:1905] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:22:21.832917 16736 ts_tablet_manager.cc:1918] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:21.833169 16736 log.cc:1196] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-1/wal/wals/bb67dcbf89dc4263bde7b34baebe2d57
I20260812 11:22:21.833796 16736 ts_tablet_manager.cc:1939] T bb67dcbf89dc4263bde7b34baebe2d57 P c5baced98daa48d4b91f0d5ca068774f: Deleting consensus metadata
I20260812 11:22:21.835817 15879 catalog_manager.cc:4841] TS c5baced98daa48d4b91f0d5ca068774f (127.15.164.194:43849): tablet bb67dcbf89dc4263bde7b34baebe2d57 (table test-table [id=f310a88f103d40df9fffa72a763d45a0]) successfully deleted
I20260812 11:22:21.839910 16734 ts_tablet_manager.cc:1918] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:22:21.840104 16734 log.cc:1196] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Deleting WAL directory at /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786533397360424-16019-0/minicluster-data/ts-2/wal/wals/bb67dcbf89dc4263bde7b34baebe2d57
I20260812 11:22:21.840685 16734 ts_tablet_manager.cc:1939] T bb67dcbf89dc4263bde7b34baebe2d57 P 2f2b21554dde492a8bd3125b2b28db9f: Deleting consensus metadata
I20260812 11:22:21.842649 15879 catalog_manager.cc:4841] TS 2f2b21554dde492a8bd3125b2b28db9f (127.15.164.195:41325): tablet bb67dcbf89dc4263bde7b34baebe2d57 (table test-table [id=f310a88f103d40df9fffa72a763d45a0]) successfully deleted
I20260812 11:22:21.921259 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16011
I20260812 11:22:21.921296 16732 tablet_replica.cc:330] T bb67dcbf89dc4263bde7b34baebe2d57 P be247249f8de4330ac8adcdf88d8d30b: stopping tablet replica
I20260812 11:22:21.948940 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16251
W20260812 11:22:21.948948 15879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.164.193:45699 (error 108)
I20260812 11:22:21.951401 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.950571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53316)
0812 11:22:21.951021 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:21.951187 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":236,"threads_started":1}
W20260812 11:22:21.951718 15879 catalog_manager.cc:4584] TS be247249f8de4330ac8adcdf88d8d30b (127.15.164.193:45699): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bb67dcbf89dc4263bde7b34baebe2d57: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
I20260812 11:22:21.958324 16695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:21.950308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49398 (local address 127.15.164.194:43849)
0812 11:22:21.950555 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:21.950562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:21.950584 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:22:21.950660 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:21.950667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:21.950801 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:21.950922 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:21.951587 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.952892 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.954239 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:21.955223 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:21.955379 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:21.956491 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:21.956505 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:21.956526 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:21.957402 (+ 876us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:21.957469 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:21.957497 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:21.957617 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:21.957761 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 11:22:21.957896 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:22:21.959225 16454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:22.005512 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.004852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53318)
0812 11:22:22.005143 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.005302 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260812 11:22:22.006919 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.006442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53320)
0812 11:22:22.006648 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.006748 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 11:22:22.049420 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16251
I20260812 11:22:22.067734 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.067223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53332)
0812 11:22:22.067466 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.067565 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:22:22.068919 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.068517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53338)
0812 11:22:22.068691 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.068783 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:22:22.083202 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16463
I20260812 11:22:22.092286 16694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.084114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36106 (local address 127.15.164.195:41325)
0812 11:22:22.084366 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:22.084373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:22.084399 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:22:22.084502 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:22.084509 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:22.084631 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:22.084769 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:22.085283 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:22.086638 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:22.088163 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:22.088902 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:22.089070 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:22.090197 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:22.090210 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:22.090241 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:22.091310 (+ 1069us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:22.091378 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:22.091407 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:22.091547 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:22.091718 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 11:22:22.091825 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:22:22.093118 16662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:22.149484 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.149006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53340)
0812 11:22:22.149222 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.149316 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:22:22.150717 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.150270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53342)
0812 11:22:22.150516 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.150589 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 11:22:22.221022 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16463
I20260812 11:22:22.253764 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 15851
I20260812 11:22:22.255158 15961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:22.365204 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:22.364632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.193:45699 (local address 127.0.0.1:53348)
0812 11:22:22.364865 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 11:22:22.365008 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.193:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 11:22:22.365293 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 15851
2026-08-12T11:22:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3172 ms)
[----------] 6 tests from EncryptionPolicyTest (24357 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:22 dist-test-slave-7kzw krb5kdc[16752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:22 dist-test-slave-7kzw krb5kdc[16752](info): set up 2 sockets
Aug 12 11:22:22 dist-test-slave-7kzw krb5kdc[16752](info): commencing operation
krb5kdc: starting...
W20260812 11:22:23.738116 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:23 dist-test-slave-7kzw krb5kdc[16752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:24.050215 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34709
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:24.400013 16780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:24.400369 16780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:24.400547 16780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:24.407608 16780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:24.407768 16780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:24.407881 16780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:24.407994 16780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:24.408082 16780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:24.417728 16780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34709
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:24.419062 16780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:24.420414 16780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:24.432788 16794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:24.432829 16791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:24.433627 16790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:24.434273 16780 server_base.cc:1034] running on GCE node
I20260812 11:22:24.435233 16780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:24.436761 16780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:24.437973 16780 hybrid_clock.cc:648] HybridClock initialized: now 1786533744437931 us; error 29 us; skew 500 ppm
I20260812 11:22:24.438357 16780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:24 dist-test-slave-7kzw krb5kdc[16752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:24.445045 16780 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:24.446784 16780 webserver.cc:460] Webserver started at http://127.0.0.1:33447/ using document root <none> and password file <none>
I20260812 11:22:24.447511 16780 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:24.447672 16780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:24.448009 16780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:24.451138 16780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "c28d4ac4868d45089605623f79d40f94"
format_stamp: "Formatted at 2026-08-12 11:22:24 on dist-test-slave-7kzw"
server_key: "2c71f60bed6c55bc7df6019720909633"
server_key_iv: "f2ca21eebb374a55350ff05271f9480c"
server_key_version: "encryptionkey@0"
I20260812 11:22:24.451930 16780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "c28d4ac4868d45089605623f79d40f94"
format_stamp: "Formatted at 2026-08-12 11:22:24 on dist-test-slave-7kzw"
server_key: "2c71f60bed6c55bc7df6019720909633"
server_key_iv: "f2ca21eebb374a55350ff05271f9480c"
server_key_version: "encryptionkey@0"
I20260812 11:22:24.457294 16780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:22:24.461227 16802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:24.462836 16780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:24.463047 16780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "c28d4ac4868d45089605623f79d40f94"
format_stamp: "Formatted at 2026-08-12 11:22:24 on dist-test-slave-7kzw"
server_key: "2c71f60bed6c55bc7df6019720909633"
server_key_iv: "f2ca21eebb374a55350ff05271f9480c"
server_key_version: "encryptionkey@0"
I20260812 11:22:24.463260 16780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:24.477632 16780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:24.482519 16780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:24.482868 16780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:24.503942 16780 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34709
I20260812 11:22:24.503959 16881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34709 every 8 connection(s)
I20260812 11:22:24.505564 16780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:24.509689 16882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:24.511504 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16780
I20260812 11:22:24.511754 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:24.512657 16019 external_mini_cluster.cc:1428] Setting key 065bdc21c7467f9657dc2bbd0ababc19
I20260812 11:22:24.522718 16882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94: Bootstrap starting.
I20260812 11:22:24.526837 16882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:24.528185 16882 log.cc:824] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:22:24 dist-test-slave-7kzw krb5kdc[16752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:22:24.531899 16882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94: No bootstrap required, opened a new log
I20260812 11:22:24.539251 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:24.514798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46329 (local address 127.0.0.1:34709)
0812 11:22:24.515698 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:24.515710 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:24.515768 (+ 58us) server_negotiation.cc:407] Connection header received
0812 11:22:24.517466 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:24.517487 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:24.517866 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:24.518171 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:24.520030 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:24.521409 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:24.523205 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:24.523928 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:24.524063 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:24.529678 (+ 5615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:24.529692 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:24.529716 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:24.529800 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:24.533997 (+ 4197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:24.535015 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:24.535024 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:24.535033 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:24.535258 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:24.535815 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:24.535826 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:24.535829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:24.536590 (+ 761us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:24.536929 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:24.537426 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 11:22:24.537822 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":433,"threads_started":1}
I20260812 11:22:24.542729 16882 raft_consensus.cc:348] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } }
I20260812 11:22:24.543213 16882 raft_consensus.cc:374] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:24.543366 16882 raft_consensus.cc:729] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c28d4ac4868d45089605623f79d40f94, State: Initialized, Role: FOLLOWER
I20260812 11:22:24.543990 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:24.543982 16882 consensus_queue.cc:260] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } }
I20260812 11:22:24.544299 16882 raft_consensus.cc:388] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:24.544451 16882 raft_consensus.cc:482] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:24.544653 16882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:24.546983 16882 raft_consensus.cc:504] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } }
I20260812 11:22:24.547539 16882 leader_election.cc:302] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c28d4ac4868d45089605623f79d40f94; no voters:
I20260812 11:22:24.548224 16882 leader_election.cc:288] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:24.548336 16894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:24.550297 16894 raft_consensus.cc:686] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [term 1 LEADER]: Becoming Leader. State: Replica: c28d4ac4868d45089605623f79d40f94, State: Running, Role: LEADER
I20260812 11:22:24.550940 16882 sys_catalog.cc:564] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:24.550946 16894 consensus_queue.cc:237] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } }
I20260812 11:22:24.554440 16897 sys_catalog.cc:455] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c28d4ac4868d45089605623f79d40f94. Latest consensus state: current_term: 1 leader_uuid: "c28d4ac4868d45089605623f79d40f94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } } }
I20260812 11:22:24.555007 16897 sys_catalog.cc:458] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:24.556349 16896 sys_catalog.cc:455] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c28d4ac4868d45089605623f79d40f94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28d4ac4868d45089605623f79d40f94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34709 } } }
I20260812 11:22:24.556726 16896 sys_catalog.cc:458] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:24.564939 16906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:24.568926 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:24.549612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54621 (local address 127.0.0.1:34709)
0812 11:22:24.549792 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:24.549798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:24.549946 (+ 148us) server_negotiation.cc:407] Connection header received
0812 11:22:24.550243 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:24.550279 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:24.550379 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:24.550485 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:24.552284 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:24.553473 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:24.555431 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:24.556181 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:24.556333 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:24.560321 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:24.560331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:24.560339 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:24.560394 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:24.564964 (+ 4570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:24.565991 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:24.566002 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:24.566008 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:24.566196 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:24.566993 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:24.567000 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:24.567006 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:24.567542 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:24.567863 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:24.568318 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 11:22:24.568498 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:22:24.571247 16906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:24.582113 16906 catalog_manager.cc:1347] Generated new cluster ID: c353b938b8d943d4a9c7c6af1e3485a7
I20260812 11:22:24.582257 16906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:24.607897 16906 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:24.609846 16906 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:24.622201 16906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c28d4ac4868d45089605623f79d40f94: Generated new TSK 0
I20260812 11:22:24.623358 16906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:24.641646 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16780
I20260812 11:22:24.643024 16877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:24.740123 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16780
W20260812 11:22:24.769578 16749 connection.cc:535] client connection to 127.0.0.1:34709 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34709): Connection reset by peer (error 104)
2026-08-12T11:22:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:24 dist-test-slave-7kzw krb5kdc[16933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:24 dist-test-slave-7kzw krb5kdc[16933](info): set up 2 sockets
Aug 12 11:22:24 dist-test-slave-7kzw krb5kdc[16933](info): commencing operation
krb5kdc: starting...
W20260812 11:22:26.163071 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.373s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:26 dist-test-slave-7kzw krb5kdc[16933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:26.481964 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43513
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:26.838960 16953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:26.839288 16953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:26.839475 16953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:26.846807 16953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:26.846928 16953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:26.847054 16953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:26.847194 16953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:26.847260 16953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:26.857406 16953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43513
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:26.858858 16953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:26.860234 16953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:26.874934 16963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:26.874835 16964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:26.874897 16967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:26.875869 16953 server_base.cc:1034] running on GCE node
I20260812 11:22:26.876811 16953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:26.878337 16953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:26.879599 16953 hybrid_clock.cc:648] HybridClock initialized: now 1786533746879530 us; error 63 us; skew 500 ppm
I20260812 11:22:26.879998 16953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:26 dist-test-slave-7kzw krb5kdc[16933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533746, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:26.883323 16953 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:26.884807 16953 webserver.cc:460] Webserver started at http://127.0.0.1:34267/ using document root <none> and password file <none>
I20260812 11:22:26.885470 16953 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:26.885574 16953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:26.885854 16953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:26.889137 16953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "4bcef6d4905646e79de2525abfd24f8c"
format_stamp: "Formatted at 2026-08-12 11:22:26 on dist-test-slave-7kzw"
server_key: "481e55736f1c238dbeef78ed86308fd3"
server_key_iv: "28fcb0d56564a67b14f49211632f8382"
server_key_version: "encryptionkey@0"
I20260812 11:22:26.889886 16953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "4bcef6d4905646e79de2525abfd24f8c"
format_stamp: "Formatted at 2026-08-12 11:22:26 on dist-test-slave-7kzw"
server_key: "481e55736f1c238dbeef78ed86308fd3"
server_key_iv: "28fcb0d56564a67b14f49211632f8382"
server_key_version: "encryptionkey@0"
I20260812 11:22:26.895362 16953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260812 11:22:26.898963 16981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:26.900372 16953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:22:26.900573 16953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "4bcef6d4905646e79de2525abfd24f8c"
format_stamp: "Formatted at 2026-08-12 11:22:26 on dist-test-slave-7kzw"
server_key: "481e55736f1c238dbeef78ed86308fd3"
server_key_iv: "28fcb0d56564a67b14f49211632f8382"
server_key_version: "encryptionkey@0"
I20260812 11:22:26.900775 16953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:26.916114 16953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:26.920627 16953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:26.920945 16953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:26.951202 16953 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43513
I20260812 11:22:26.951251 17064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43513 every 8 connection(s)
I20260812 11:22:26.953584 16953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:26.954492 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 16953
I20260812 11:22:26.954742 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:26.955436 16019 external_mini_cluster.cc:1428] Setting key 62347f59453609a794c552c7ac1aa5f9
I20260812 11:22:26.958943 17065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:26.977720 17065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c: Bootstrap starting.
I20260812 11:22:26.980858 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:26.958241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46343 (local address 127.0.0.1:43513)
0812 11:22:26.962786 (+ 4545us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:26.962809 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:26.962873 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:22:26.965281 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:26.965318 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:26.965970 (+ 652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:26.966633 (+ 663us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:26.967398 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:26.969714 (+ 2316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:26.971894 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:26.973382 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:26.973649 (+ 267us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:26.975279 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:26.975297 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:26.975324 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:26.976159 (+ 835us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:26.976285 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:26.976332 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:26.976523 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:26.978915 (+ 2392us) server_negotiation.cc:299] Negotiation successful
0812 11:22:26.979175 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4221,"thread_start_us":3908,"threads_started":1}
I20260812 11:22:26.982265 17065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:26.983907 17065 log.cc:824] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:26.985947 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:26.987825 17065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c: No bootstrap required, opened a new log
I20260812 11:22:27.000252 17065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } }
I20260812 11:22:27.000872 17065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:27.001061 17065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bcef6d4905646e79de2525abfd24f8c, State: Initialized, Role: FOLLOWER
I20260812 11:22:27.001772 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:26.992468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49919 (local address 127.0.0.1:43513)
0812 11:22:26.992733 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:26.992742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:26.992768 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:22:26.992947 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:26.992955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:26.993059 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:26.993197 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:26.993888 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:26.995372 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:26.997718 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:26.998711 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:26.998872 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:27.000410 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:27.000417 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:27.000421 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:27.000446 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:27.000505 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:27.000534 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:27.000696 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:27.000944 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 11:22:27.001316 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:22:27.001943 17065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } }
I20260812 11:22:27.002310 17065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:27.002516 17065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:27.002753 17065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:27.005805 17065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } }
I20260812 11:22:27.006438 17065 leader_election.cc:302] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bcef6d4905646e79de2525abfd24f8c; no voters:
I20260812 11:22:27.007306 17065 leader_election.cc:288] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:27.007452 17078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:27.008313 17078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [term 1 LEADER]: Becoming Leader. State: Replica: 4bcef6d4905646e79de2525abfd24f8c, State: Running, Role: LEADER
I20260812 11:22:27.008996 17078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } }
I20260812 11:22:27.010031 17065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:27.013404 17080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bcef6d4905646e79de2525abfd24f8c. Latest consensus state: current_term: 1 leader_uuid: "4bcef6d4905646e79de2525abfd24f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } } }
I20260812 11:22:27.013890 17080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:27.013394 17079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bcef6d4905646e79de2525abfd24f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcef6d4905646e79de2525abfd24f8c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43513 } } }
I20260812 11:22:27.014568 17079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:27.016921 17089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:27.022224 17089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:27.034976 17089 catalog_manager.cc:1347] Generated new cluster ID: 837e25ef264b4bb9a55b6d55878f735d
I20260812 11:22:27.035154 17089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:27.045797 17089 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:27.047238 17089 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:27.058398 17089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bcef6d4905646e79de2525abfd24f8c: Generated new TSK 0
I20260812 11:22:27.059381 17089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:27.067792 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16953
W20260812 11:22:27.069860 17056 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46343
W20260812 11:22:27.070854 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 16953: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:27.071089 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 16953
W20260812 11:22:27.100083 16929 connection.cc:535] client connection to 127.0.0.1:43513 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43513): Connection reset by peer (error 104)
2026-08-12T11:22:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2330 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:27 dist-test-slave-7kzw krb5kdc[17117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:27 dist-test-slave-7kzw krb5kdc[17117](info): set up 2 sockets
Aug 12 11:22:27 dist-test-slave-7kzw krb5kdc[17117](info): commencing operation
krb5kdc: starting...
W20260812 11:22:28.432468 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:28 dist-test-slave-7kzw krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:28.745970 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42653
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:29.106333 17137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:29.106653 17137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:29.106763 17137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:29.113960 17137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:29.114071 17137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:29.114118 17137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:29.114172 17137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:29.114217 17137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:29.124750 17137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42653
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:29.126030 17137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:29.127456 17137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:29.140028 17144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:29.140117 17147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:29.140380 17149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:29.141355 17137 server_base.cc:1034] running on GCE node
I20260812 11:22:29.142114 17137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:29.143635 17137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:29.144843 17137 hybrid_clock.cc:648] HybridClock initialized: now 1786533749144793 us; error 38 us; skew 500 ppm
I20260812 11:22:29.145155 17137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:29 dist-test-slave-7kzw krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533749, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:29.148432 17137 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:29.149972 17137 webserver.cc:460] Webserver started at http://127.0.0.1:39661/ using document root <none> and password file <none>
I20260812 11:22:29.150724 17137 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:29.150843 17137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:29.151137 17137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:29.154129 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "d6e34d2a4a3d43cf823c053b3f6ac355"
format_stamp: "Formatted at 2026-08-12 11:22:29 on dist-test-slave-7kzw"
server_key: "f12d88d416833073333a8f7c2dff7be0"
server_key_iv: "a75dcd4c73d873d47e4a08877edcceae"
server_key_version: "encryptionkey@0"
I20260812 11:22:29.154982 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "d6e34d2a4a3d43cf823c053b3f6ac355"
format_stamp: "Formatted at 2026-08-12 11:22:29 on dist-test-slave-7kzw"
server_key: "f12d88d416833073333a8f7c2dff7be0"
server_key_iv: "a75dcd4c73d873d47e4a08877edcceae"
server_key_version: "encryptionkey@0"
I20260812 11:22:29.160257 17137 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:29.163892 17158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:29.165309 17137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:29.165470 17137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "d6e34d2a4a3d43cf823c053b3f6ac355"
format_stamp: "Formatted at 2026-08-12 11:22:29 on dist-test-slave-7kzw"
server_key: "f12d88d416833073333a8f7c2dff7be0"
server_key_iv: "a75dcd4c73d873d47e4a08877edcceae"
server_key_version: "encryptionkey@0"
I20260812 11:22:29.165657 17137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:29.171496 17137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:29.175941 17137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:29.176204 17137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:29.196823 17137 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42653
I20260812 11:22:29.196870 17234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42653 every 8 connection(s)
I20260812 11:22:29.198449 17137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:29.202732 17235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:29.208318 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17137
I20260812 11:22:29.208515 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:29.209030 16019 external_mini_cluster.cc:1428] Setting key db07a2fe3ca91a591910a55607d551ca
I20260812 11:22:29.214562 17235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355: Bootstrap starting.
I20260812 11:22:29.217281 17243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:29.211010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47815 (local address 127.0.0.1:42653)
0812 11:22:29.211916 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:29.211928 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:29.211975 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:22:29.213746 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:29.213770 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:29.214140 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:29.214590 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:29.215676 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:29.215682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:29.215696 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:29.215717 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:29.215770 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:29.215789 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:29.216033 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:29.216198 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 11:22:29.216381 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":397,"threads_started":1}
I20260812 11:22:29.218421 17235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:29.219645 17235 log.cc:824] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:29.221474 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:29.222738 17235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355: No bootstrap required, opened a new log
I20260812 11:22:29.229267 17243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:29.226376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48255 (local address 127.0.0.1:42653)
0812 11:22:29.226601 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:29.226607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:29.227084 (+ 477us) server_negotiation.cc:407] Connection header received
0812 11:22:29.227237 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:29.227242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:29.227317 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:29.227429 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:29.228546 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:29.228552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:29.228556 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:29.228574 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:29.228625 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:29.228658 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:29.228793 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:29.228899 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:22:29.228956 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:22:29.231732 17235 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } }
I20260812 11:22:29.232079 17235 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:29.232159 17235 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34d2a4a3d43cf823c053b3f6ac355, State: Initialized, Role: FOLLOWER
I20260812 11:22:29.232690 17235 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } }
I20260812 11:22:29.232913 17235 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:29.233014 17235 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:29.233163 17235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:29.235460 17235 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } }
I20260812 11:22:29.236068 17235 leader_election.cc:302] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e34d2a4a3d43cf823c053b3f6ac355; no voters:
I20260812 11:22:29.236836 17235 leader_election.cc:288] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:29.236954 17254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:29.237744 17254 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [term 1 LEADER]: Becoming Leader. State: Replica: d6e34d2a4a3d43cf823c053b3f6ac355, State: Running, Role: LEADER
I20260812 11:22:29.238435 17254 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } }
I20260812 11:22:29.239529 17235 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:29.241698 17255 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } } }
I20260812 11:22:29.242033 17255 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:29.243232 17257 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e34d2a4a3d43cf823c053b3f6ac355. Latest consensus state: current_term: 1 leader_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e34d2a4a3d43cf823c053b3f6ac355" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42653 } } }
I20260812 11:22:29.243722 17257 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:29.245615 17263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:29.251614 17263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:29.260756 17263 catalog_manager.cc:1347] Generated new cluster ID: 895620e08883484db7cdf952452542a8
I20260812 11:22:29.260890 17263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:29.303910 17263 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:29.304450 17263 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:29.314218 17263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e34d2a4a3d43cf823c053b3f6ac355: Generated new TSK 0
I20260812 11:22:29.315212 17263 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:29.329097 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17137
W20260812 11:22:29.330533 17227 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47815
W20260812 11:22:29.331317 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17137: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:29.331477 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17137
2026-08-12T11:22:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2261 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:29 dist-test-slave-7kzw krb5kdc[17291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:29 dist-test-slave-7kzw krb5kdc[17291](info): set up 2 sockets
Aug 12 11:22:29 dist-test-slave-7kzw krb5kdc[17291](info): commencing operation
krb5kdc: starting...
W20260812 11:22:30.718853 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:30 dist-test-slave-7kzw krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:31.049669 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44109
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:31.405846 17309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:31.406162 17309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:31.406354 17309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:31.413672 17309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:31.413798 17309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:31.413898 17309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:31.414014 17309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:31.414098 17309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:31.424067 17309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:31.425472 17309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:31.426872 17309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:31.439357 17314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:31.439293 17319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:31.439256 17316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:31.441164 17309 server_base.cc:1034] running on GCE node
I20260812 11:22:31.442123 17309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:31.443768 17309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:31.444986 17309 hybrid_clock.cc:648] HybridClock initialized: now 1786533751444936 us; error 38 us; skew 500 ppm
I20260812 11:22:31.445387 17309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:31 dist-test-slave-7kzw krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533751, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:31.453572 17309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:31.455314 17309 webserver.cc:460] Webserver started at http://127.0.0.1:37405/ using document root <none> and password file <none>
I20260812 11:22:31.456019 17309 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:31.456132 17309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:31.456427 17309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:31.459591 17309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "c2620ca513894d8581685effb5fe0782"
format_stamp: "Formatted at 2026-08-12 11:22:31 on dist-test-slave-7kzw"
server_key: "aab944e3fa3f4e5eefeeac78722655c0"
server_key_iv: "54570ca6595327fc1d82ede5884bced9"
server_key_version: "encryptionkey@0"
I20260812 11:22:31.460345 17309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "c2620ca513894d8581685effb5fe0782"
format_stamp: "Formatted at 2026-08-12 11:22:31 on dist-test-slave-7kzw"
server_key: "aab944e3fa3f4e5eefeeac78722655c0"
server_key_iv: "54570ca6595327fc1d82ede5884bced9"
server_key_version: "encryptionkey@0"
I20260812 11:22:31.465525 17309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:22:31.469106 17329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:31.470448 17309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:31.470711 17309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "c2620ca513894d8581685effb5fe0782"
format_stamp: "Formatted at 2026-08-12 11:22:31 on dist-test-slave-7kzw"
server_key: "aab944e3fa3f4e5eefeeac78722655c0"
server_key_iv: "54570ca6595327fc1d82ede5884bced9"
server_key_version: "encryptionkey@0"
I20260812 11:22:31.470913 17309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:31.497748 17309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:31.502377 17309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:31.502748 17309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:31.522888 17309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44109
I20260812 11:22:31.522935 17423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44109 every 8 connection(s)
I20260812 11:22:31.524398 17309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:31.528393 17425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:31.532752 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17309
I20260812 11:22:31.532958 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:31.533530 16019 external_mini_cluster.cc:1428] Setting key 80936ec9d0156474c5c48652580c7fea
I20260812 11:22:31.542479 17425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782: Bootstrap starting.
I20260812 11:22:31.546700 17425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:31.548210 17425 log.cc:824] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:22:31 dist-test-slave-7kzw krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:22:31.551506 17425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782: No bootstrap required, opened a new log
I20260812 11:22:31.558714 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:31.535473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60159 (local address 127.0.0.1:44109)
0812 11:22:31.536265 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:31.536277 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:31.536323 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:22:31.537916 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:31.537939 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:31.538355 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:31.538775 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:31.540801 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:31.542255 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:31.544086 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:31.544809 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:31.544967 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:31.550600 (+ 5633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:31.550610 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:31.550626 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:31.550672 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:31.554033 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:31.554914 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:31.554921 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:31.554932 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:31.555127 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:31.555558 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:31.555562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:31.555564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:31.556185 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:31.556543 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:31.557076 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 11:22:31.557548 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":381,"threads_started":1}
I20260812 11:22:31.559882 17425 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } }
I20260812 11:22:31.560276 17425 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:31.560405 17425 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2620ca513894d8581685effb5fe0782, State: Initialized, Role: FOLLOWER
I20260812 11:22:31.560982 17425 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } }
I20260812 11:22:31.561246 17425 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:31.561434 17425 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:31.561641 17425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:31.562749 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:31.564874 17425 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } }
I20260812 11:22:31.565531 17425 leader_election.cc:302] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2620ca513894d8581685effb5fe0782; no voters:
I20260812 11:22:31.566604 17425 leader_election.cc:288] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:31.566736 17432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:31.567533 17432 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [term 1 LEADER]: Becoming Leader. State: Replica: c2620ca513894d8581685effb5fe0782, State: Running, Role: LEADER
I20260812 11:22:31.568271 17432 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } }
I20260812 11:22:31.570343 17425 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:31.571319 17440 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2620ca513894d8581685effb5fe0782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } } }
I20260812 11:22:31.571656 17440 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:31.571830 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2620ca513894d8581685effb5fe0782. Latest consensus state: current_term: 1 leader_uuid: "c2620ca513894d8581685effb5fe0782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2620ca513894d8581685effb5fe0782" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44109 } } }
I20260812 11:22:31.572166 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:31.580171 17449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:31.587002 17449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:31.592919 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:31.568968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48835 (local address 127.0.0.1:44109)
0812 11:22:31.569131 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:31.569137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:31.569812 (+ 675us) server_negotiation.cc:407] Connection header received
0812 11:22:31.570012 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:31.570018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:31.570108 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:31.570222 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:31.572499 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:31.574004 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:31.576555 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:31.577592 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:31.577798 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:31.581741 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:31.581748 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:31.581752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:31.581801 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:31.587201 (+ 5400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:31.588565 (+ 1364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:31.588573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:31.588579 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:31.588778 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:31.589426 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:31.589435 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:31.589440 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:31.590031 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:31.591802 (+ 1771us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:31.592017 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:22:31.592358 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:22:31.599404 17449 catalog_manager.cc:1347] Generated new cluster ID: e49fecd59a8a4f34811608eb2d486b28
I20260812 11:22:31.599532 17449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:31.620545 17449 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:31.622007 17449 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:31.638028 17449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2620ca513894d8581685effb5fe0782: Generated new TSK 0
I20260812 11:22:31.639040 17449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:31.655864 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17309
I20260812 11:22:31.657318 17415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:31.755685 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17309
2026-08-12T11:22:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2423 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:31 dist-test-slave-7kzw krb5kdc[17476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:31 dist-test-slave-7kzw krb5kdc[17476](info): set up 2 sockets
Aug 12 11:22:31 dist-test-slave-7kzw krb5kdc[17476](info): commencing operation
krb5kdc: starting...
W20260812 11:22:33.115960 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:33 dist-test-slave-7kzw krb5kdc[17476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:33.433511 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:33.802858 17492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:33.803166 17492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:33.803260 17492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:33.810869 17492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:33.810997 17492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:33.811046 17492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:33.811103 17492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:33.811149 17492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:33.821197 17492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:33.822587 17492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:33.823896 17492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:33.836550 17499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:33.836679 17498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:33.836608 17502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:33.837893 17492 server_base.cc:1034] running on GCE node
I20260812 11:22:33.838812 17492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:33.840304 17492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:33.841567 17492 hybrid_clock.cc:648] HybridClock initialized: now 1786533753841496 us; error 54 us; skew 500 ppm
I20260812 11:22:33.842031 17492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:33 dist-test-slave-7kzw krb5kdc[17476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533753, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:33.845839 17492 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:33.847507 17492 webserver.cc:460] Webserver started at http://127.0.0.1:41489/ using document root <none> and password file <none>
I20260812 11:22:33.848301 17492 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:33.848459 17492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:33.848796 17492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:33.851997 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "01241377e24549d7b5c62693b5386b88"
format_stamp: "Formatted at 2026-08-12 11:22:33 on dist-test-slave-7kzw"
server_key: "0d81c7673e56dd13b4cdf01718ee85a0"
server_key_iv: "1326f91d996f88ee5cab6ad1f0dfd164"
server_key_version: "encryptionkey@0"
I20260812 11:22:33.852818 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "01241377e24549d7b5c62693b5386b88"
format_stamp: "Formatted at 2026-08-12 11:22:33 on dist-test-slave-7kzw"
server_key: "0d81c7673e56dd13b4cdf01718ee85a0"
server_key_iv: "1326f91d996f88ee5cab6ad1f0dfd164"
server_key_version: "encryptionkey@0"
I20260812 11:22:33.858362 17492 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:22:33.862201 17513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:33.863710 17492 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:33.863932 17492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "01241377e24549d7b5c62693b5386b88"
format_stamp: "Formatted at 2026-08-12 11:22:33 on dist-test-slave-7kzw"
server_key: "0d81c7673e56dd13b4cdf01718ee85a0"
server_key_iv: "1326f91d996f88ee5cab6ad1f0dfd164"
server_key_version: "encryptionkey@0"
I20260812 11:22:33.864154 17492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:33.893981 17492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:33.898749 17492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:33.899093 17492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:33.919829 17492 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40221
I20260812 11:22:33.919891 17597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40221 every 8 connection(s)
I20260812 11:22:33.921370 17492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:33.925488 17598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:33.929791 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17492
I20260812 11:22:33.930001 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:33.930583 16019 external_mini_cluster.cc:1428] Setting key 27abed4d147cf7399ee7da3d32c4af8a
I20260812 11:22:33.939481 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88: Bootstrap starting.
I20260812 11:22:33.943615 17598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:33.945117 17598 log.cc:824] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:33.948005 17606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:33.932907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33687 (local address 127.0.0.1:40221)
0812 11:22:33.934159 (+ 1252us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:33.934175 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:33.934356 (+ 181us) server_negotiation.cc:407] Connection header received
0812 11:22:33.937238 (+ 2882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:33.937277 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:33.937901 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:33.938394 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:33.939010 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:33.941047 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:33.942655 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:33.943767 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:33.943974 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:33.945178 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:33.945190 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:33.945210 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:33.946056 (+ 846us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:33.946140 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:33.946169 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:33.946283 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:33.946651 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 11:22:33.946982 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960,"thread_start_us":528,"threads_started":1}
I20260812 11:22:33.948751 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88: No bootstrap required, opened a new log
I20260812 11:22:33.952589 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:33.960206 17598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } }
I20260812 11:22:33.960680 17598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:33.960816 17598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01241377e24549d7b5c62693b5386b88, State: Initialized, Role: FOLLOWER
I20260812 11:22:33.961663 17598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } }
I20260812 11:22:33.961992 17598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:33.962155 17598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:33.962345 17598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:33.965508 17606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:33.958378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54087 (local address 127.0.0.1:40221)
0812 11:22:33.958662 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:33.958669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:33.958906 (+ 237us) server_negotiation.cc:407] Connection header received
0812 11:22:33.959096 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:33.959100 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:33.959170 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:33.959268 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:33.959968 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:33.960832 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:33.962824 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:33.963285 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:33.963393 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:33.964691 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:33.964696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:33.964699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:33.964719 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:33.964765 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:33.964784 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:33.964859 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:33.965037 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 11:22:33.965120 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260812 11:22:33.965857 17598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } }
I20260812 11:22:33.966583 17598 leader_election.cc:302] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01241377e24549d7b5c62693b5386b88; no voters:
I20260812 11:22:33.967382 17598 leader_election.cc:288] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:33.967499 17619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:33.968442 17619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [term 1 LEADER]: Becoming Leader. State: Replica: 01241377e24549d7b5c62693b5386b88, State: Running, Role: LEADER
I20260812 11:22:33.969201 17619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } }
I20260812 11:22:33.970206 17598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:33.972678 17620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01241377e24549d7b5c62693b5386b88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } } }
I20260812 11:22:33.973209 17620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:33.972681 17621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01241377e24549d7b5c62693b5386b88. Latest consensus state: current_term: 1 leader_uuid: "01241377e24549d7b5c62693b5386b88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01241377e24549d7b5c62693b5386b88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40221 } } }
I20260812 11:22:33.974069 17621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:33.982611 17627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:33.988248 17627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:33.998600 17627 catalog_manager.cc:1347] Generated new cluster ID: ad2ef83dd61e4e3c8b167d5949327694
I20260812 11:22:33.998746 17627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:34.034166 17627 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:34.036391 17627 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:34.050349 17627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01241377e24549d7b5c62693b5386b88: Generated new TSK 0
I20260812 11:22:34.051317 17627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:34.061791 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17492
W20260812 11:22:34.063788 17592 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33687
W20260812 11:22:34.064983 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17492: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:34.065287 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17492
2026-08-12T11:22:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2315 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:34 dist-test-slave-7kzw krb5kdc[17656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:34 dist-test-slave-7kzw krb5kdc[17656](info): set up 2 sockets
Aug 12 11:22:34 dist-test-slave-7kzw krb5kdc[17656](info): commencing operation
krb5kdc: starting...
W20260812 11:22:35.440593 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:35 dist-test-slave-7kzw krb5kdc[17656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:35.768195 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33363
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:36.126078 17672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:36.126447 17672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:36.126649 17672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:36.133937 17672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:36.134097 17672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:36.134207 17672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:36.134333 17672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:36.134413 17672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:36.144440 17672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:36.145823 17672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:36.147300 17672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:36.159884 17686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:36.159934 17689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:36.160151 17685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:36.160815 17672 server_base.cc:1034] running on GCE node
I20260812 11:22:36.161687 17672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:36.163215 17672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:36.164460 17672 hybrid_clock.cc:648] HybridClock initialized: now 1786533756164409 us; error 46 us; skew 500 ppm
I20260812 11:22:36.164860 17672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:36 dist-test-slave-7kzw krb5kdc[17656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533756, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:36.168367 17672 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:36.169982 17672 webserver.cc:460] Webserver started at http://127.0.0.1:36795/ using document root <none> and password file <none>
I20260812 11:22:36.170790 17672 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:36.170954 17672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:36.171288 17672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:36.174340 17672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "896d89f807174a578fd3f87f9de7bcd7"
format_stamp: "Formatted at 2026-08-12 11:22:36 on dist-test-slave-7kzw"
server_key: "d54ec39634582d99531ea9b10cd5ce42"
server_key_iv: "fe1458c97ac74117d78c5e65f21a02bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:36.175205 17672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "896d89f807174a578fd3f87f9de7bcd7"
format_stamp: "Formatted at 2026-08-12 11:22:36 on dist-test-slave-7kzw"
server_key: "d54ec39634582d99531ea9b10cd5ce42"
server_key_iv: "fe1458c97ac74117d78c5e65f21a02bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:36.180620 17672 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:36.184170 17698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:36.185492 17672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:22:36.185683 17672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "896d89f807174a578fd3f87f9de7bcd7"
format_stamp: "Formatted at 2026-08-12 11:22:36 on dist-test-slave-7kzw"
server_key: "d54ec39634582d99531ea9b10cd5ce42"
server_key_iv: "fe1458c97ac74117d78c5e65f21a02bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:36.185897 17672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:36.192373 17672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:36.196980 17672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:36.197355 17672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:36.219336 17672 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33363
I20260812 11:22:36.219393 17786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33363 every 8 connection(s)
I20260812 11:22:36.221117 17672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:36.225159 17787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:36.230620 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17672
I20260812 11:22:36.230856 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:36.231400 16019 external_mini_cluster.cc:1428] Setting key ff64e9bc1e7207b37934839b26ffe468
I20260812 11:22:36.236542 17787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7: Bootstrap starting.
I20260812 11:22:36.240067 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:36.233330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50945 (local address 127.0.0.1:33363)
0812 11:22:36.234324 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:36.234336 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:36.234390 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:22:36.236304 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:36.236328 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:36.236735 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:36.237110 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:36.238289 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:36.238296 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:36.238310 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:36.238328 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:36.238397 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:36.238418 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:36.238721 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:36.238839 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 11:22:36.239083 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":486,"threads_started":1}
I20260812 11:22:36.240437 17787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:36.241531 17787 log.cc:824] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:36.244386 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:36.245024 17787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7: No bootstrap required, opened a new log
I20260812 11:22:36.252784 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:36.249965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55733 (local address 127.0.0.1:33363)
0812 11:22:36.250173 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:36.250179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:36.250666 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:22:36.250831 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:36.250836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:36.250905 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:36.251020 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:36.252068 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:36.252073 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:36.252077 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:36.252096 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:36.252148 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:36.252175 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:36.252331 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:36.252398 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 11:22:36.252458 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:22:36.255458 17787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:22:36.255842 17787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:36.255955 17787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896d89f807174a578fd3f87f9de7bcd7, State: Initialized, Role: FOLLOWER
I20260812 11:22:36.256578 17787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:22:36.256845 17787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:36.256955 17787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:36.257148 17787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:36.259895 17787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:22:36.260419 17787 leader_election.cc:302] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 896d89f807174a578fd3f87f9de7bcd7; no voters:
I20260812 11:22:36.261251 17787 leader_election.cc:288] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:36.261464 17803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:36.262275 17803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [term 1 LEADER]: Becoming Leader. State: Replica: 896d89f807174a578fd3f87f9de7bcd7, State: Running, Role: LEADER
I20260812 11:22:36.262951 17803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:22:36.263626 17787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:36.266335 17804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "896d89f807174a578fd3f87f9de7bcd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } } }
I20260812 11:22:36.266377 17805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896d89f807174a578fd3f87f9de7bcd7. Latest consensus state: current_term: 1 leader_uuid: "896d89f807174a578fd3f87f9de7bcd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896d89f807174a578fd3f87f9de7bcd7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } } }
I20260812 11:22:36.267020 17804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:36.267015 17805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:36.270623 17811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:36.276824 17811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:36.286708 17811 catalog_manager.cc:1347] Generated new cluster ID: a265554c9aa442299d0a1c848ceefc9b
I20260812 11:22:36.286897 17811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:36.302697 17811 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:36.303212 17811 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:36.320773 17811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 896d89f807174a578fd3f87f9de7bcd7: Generated new TSK 0
I20260812 11:22:36.321735 17811 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:36.333604 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17672
W20260812 11:22:36.334945 17781 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50945
W20260812 11:22:36.335704 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17672: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:36.335883 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17672
2026-08-12T11:22:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2267 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:36 dist-test-slave-7kzw krb5kdc[17835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:36 dist-test-slave-7kzw krb5kdc[17835](info): set up 2 sockets
Aug 12 11:22:36 dist-test-slave-7kzw krb5kdc[17835](info): commencing operation
krb5kdc: starting...
W20260812 11:22:37.770849 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.383s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:37 dist-test-slave-7kzw krb5kdc[17835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:38.095335 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:38.449322 17858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:38.449640 17858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:38.449760 17858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:38.457648 17858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:38.457783 17858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:38.457834 17858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:38.457888 17858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:38.457934 17858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:38.467978 17858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:38.469754 17858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:38.471161 17858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:38.483466 17864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:38.483543 17866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:38.483557 17869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:38.489425 17858 server_base.cc:1034] running on GCE node
I20260812 11:22:38.490374 17858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:38.492020 17858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:38.493255 17858 hybrid_clock.cc:648] HybridClock initialized: now 1786533758493199 us; error 46 us; skew 500 ppm
I20260812 11:22:38.493717 17858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:38 dist-test-slave-7kzw krb5kdc[17835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533758, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:38.497182 17858 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:38.498975 17858 webserver.cc:460] Webserver started at http://127.0.0.1:42455/ using document root <none> and password file <none>
I20260812 11:22:38.499706 17858 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:38.499819 17858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:38.500097 17858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:38.503274 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "0e4a3458f2ff48d89da919fc5a1e79af"
format_stamp: "Formatted at 2026-08-12 11:22:38 on dist-test-slave-7kzw"
server_key: "788868f568c9a60d69464d8d63ea255c"
server_key_iv: "071afac57e42ca51cb2e5bc1155c44f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:38.504045 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "0e4a3458f2ff48d89da919fc5a1e79af"
format_stamp: "Formatted at 2026-08-12 11:22:38 on dist-test-slave-7kzw"
server_key: "788868f568c9a60d69464d8d63ea255c"
server_key_iv: "071afac57e42ca51cb2e5bc1155c44f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:38.509805 17858 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:22:38.513906 17878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:38.515508 17858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:38.515726 17858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "0e4a3458f2ff48d89da919fc5a1e79af"
format_stamp: "Formatted at 2026-08-12 11:22:38 on dist-test-slave-7kzw"
server_key: "788868f568c9a60d69464d8d63ea255c"
server_key_iv: "071afac57e42ca51cb2e5bc1155c44f9"
server_key_version: "encryptionkey@0"
I20260812 11:22:38.515954 17858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:38.531504 17858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:38.535960 17858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:38.536281 17858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:38.556797 17858 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34559
I20260812 11:22:38.556838 17968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34559 every 8 connection(s)
I20260812 11:22:38.558301 17858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:38.562361 17972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:38.566993 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 17858
I20260812 11:22:38.567188 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:38.567687 16019 external_mini_cluster.cc:1428] Setting key 52a242df42e38c27436c67a749c00f76
I20260812 11:22:38.573967 17972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af: Bootstrap starting.
I20260812 11:22:38.577325 17972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:38.578444 17972 log.cc:824] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:38.581578 17972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af: No bootstrap required, opened a new log
Aug 12 11:22:38 dist-test-slave-7kzw krb5kdc[17835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:22:38.589663 17972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } }
I20260812 11:22:38.590163 17972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:38.590303 17972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4a3458f2ff48d89da919fc5a1e79af, State: Initialized, Role: FOLLOWER
I20260812 11:22:38.591049 17972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } }
I20260812 11:22:38.591308 17972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:38.591480 17972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:38.591526 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:38.569689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:42847 (local address 127.0.0.1:34559)
0812 11:22:38.570585 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:38.570598 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:38.570644 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:22:38.572574 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:38.572599 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:38.572997 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:38.573392 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:38.575061 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:38.576422 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:38.577810 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:38.578569 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:38.578766 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:38.583294 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:38.583302 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:38.583320 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:38.583364 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:38.586727 (+ 3363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:38.587630 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:38.587637 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:38.587653 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:38.587846 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:38.588359 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:38.588363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:38.588368 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:38.588982 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:38.589319 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:38.589874 (+ 555us) server_negotiation.cc:299] Negotiation successful
0812 11:22:38.590298 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":369,"threads_started":1}
I20260812 11:22:38.591676 17972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:38.594280 17972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } }
I20260812 11:22:38.594925 17972 leader_election.cc:302] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e4a3458f2ff48d89da919fc5a1e79af; no voters:
I20260812 11:22:38.595626 17972 leader_election.cc:288] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:38.595661 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:38.595758 17980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:38.598326 17972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:38.601643 17980 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [term 1 LEADER]: Becoming Leader. State: Replica: 0e4a3458f2ff48d89da919fc5a1e79af, State: Running, Role: LEADER
I20260812 11:22:38.602481 17980 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } }
I20260812 11:22:38.606093 17981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } } }
I20260812 11:22:38.606611 17981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:38.607319 17983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e4a3458f2ff48d89da919fc5a1e79af. Latest consensus state: current_term: 1 leader_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4a3458f2ff48d89da919fc5a1e79af" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34559 } } }
I20260812 11:22:38.607677 17983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:38.615222 17995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:38.621722 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:38.600620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:49659 (local address 127.0.0.1:34559)
0812 11:22:38.600809 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:38.600819 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:38.601531 (+ 712us) server_negotiation.cc:407] Connection header received
0812 11:22:38.601826 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:38.601831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:38.601911 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:38.601979 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:38.603950 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:38.604942 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:38.606865 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:38.607750 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:38.607918 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:38.612467 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:38.612478 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:38.612486 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:38.612541 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:38.616954 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:38.618064 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:38.618073 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:38.618079 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:38.618275 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:38.618950 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:38.618955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:38.618959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:38.619452 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:38.619745 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:38.621096 (+ 1351us) server_negotiation.cc:299] Negotiation successful
0812 11:22:38.621291 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:22:38.621829 17995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:38.632382 17995 catalog_manager.cc:1347] Generated new cluster ID: 12a13343a90d4ac891265d66611f642e
I20260812 11:22:38.632513 17995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:38.662513 17995 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:38.664566 17995 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:38.674995 17995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e4a3458f2ff48d89da919fc5a1e79af: Generated new TSK 0
I20260812 11:22:38.675969 17995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:38.691594 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 17858
I20260812 11:22:38.692716 17959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:38.792268 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 17858
W20260812 11:22:38.821573 17833 connection.cc:535] client connection to 127.0.0.1:34559 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34559): Connection reset by peer (error 104)
2026-08-12T11:22:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:38 dist-test-slave-7kzw krb5kdc[18020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:38 dist-test-slave-7kzw krb5kdc[18020](info): set up 2 sockets
Aug 12 11:22:38 dist-test-slave-7kzw krb5kdc[18020](info): commencing operation
krb5kdc: starting...
W20260812 11:22:40.166208 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:40 dist-test-slave-7kzw krb5kdc[18020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:40.493942 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42123
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:40.850519 18041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:40.850868 18041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:40.850968 18041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:40.858318 18041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:40.858440 18041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:40.858564 18041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:40.858637 18041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:40.858688 18041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:40.868937 18041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:40.870261 18041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:40.871649 18041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:40.883867 18054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.884116 18048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:40.884089 18051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:40.885121 18041 server_base.cc:1034] running on GCE node
I20260812 11:22:40.885967 18041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:40.887472 18041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:40.888684 18041 hybrid_clock.cc:648] HybridClock initialized: now 1786533760888642 us; error 37 us; skew 500 ppm
I20260812 11:22:40.889005 18041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:40 dist-test-slave-7kzw krb5kdc[18020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533760, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:40.892355 18041 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:40.893966 18041 webserver.cc:460] Webserver started at http://127.0.0.1:40507/ using document root <none> and password file <none>
I20260812 11:22:40.894797 18041 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:40.894938 18041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:40.895280 18041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:40.898550 18041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "9eb8c811a2214d108a7ffe33806eb307"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-7kzw"
server_key: "9e9b1a937ce2528148a9a3a61e467c2c"
server_key_iv: "ce2aa8a3c824b5d11d676faa8bb6e9fc"
server_key_version: "encryptionkey@0"
I20260812 11:22:40.899364 18041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "9eb8c811a2214d108a7ffe33806eb307"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-7kzw"
server_key: "9e9b1a937ce2528148a9a3a61e467c2c"
server_key_iv: "ce2aa8a3c824b5d11d676faa8bb6e9fc"
server_key_version: "encryptionkey@0"
I20260812 11:22:40.904964 18041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:22:40.909116 18063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:40.910662 18041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:40.910879 18041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "9eb8c811a2214d108a7ffe33806eb307"
format_stamp: "Formatted at 2026-08-12 11:22:40 on dist-test-slave-7kzw"
server_key: "9e9b1a937ce2528148a9a3a61e467c2c"
server_key_iv: "ce2aa8a3c824b5d11d676faa8bb6e9fc"
server_key_version: "encryptionkey@0"
I20260812 11:22:40.911108 18041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:40.922628 18041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:40.927170 18041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:40.927501 18041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:40.947993 18041 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42123
I20260812 11:22:40.948041 18135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42123 every 8 connection(s)
I20260812 11:22:40.949514 18041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:40.953639 18136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:40.956907 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18041
I20260812 11:22:40.957126 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:40.957577 16019 external_mini_cluster.cc:1428] Setting key b4b130b956c878ab6283898c346c5606
I20260812 11:22:40.965969 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: Bootstrap starting.
I20260812 11:22:40.969276 18136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:40.970427 18136 log.cc:824] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:40.971596 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.959709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:56509 (local address 127.0.0.1:42123)
0812 11:22:40.960537 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:40.960549 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:40.960617 (+ 68us) server_negotiation.cc:407] Connection header received
0812 11:22:40.962352 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:40.962376 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:40.962880 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:40.963313 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:40.963901 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.965193 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.966777 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.967476 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.967792 (+ 316us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.969082 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:40.969090 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:40.969105 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:40.969718 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:40.969804 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:40.969835 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:40.970019 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:40.970316 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 11:22:40.970552 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":340,"threads_started":1}
I20260812 11:22:40.973425 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: No bootstrap required, opened a new log
I20260812 11:22:40.975581 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:40.982090 18136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } }
I20260812 11:22:40.982597 18136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:40.982728 18136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb8c811a2214d108a7ffe33806eb307, State: Initialized, Role: FOLLOWER
I20260812 11:22:40.983417 18136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } }
I20260812 11:22:40.983700 18136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:40.983857 18136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:40.984040 18136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:40.986508 18136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } }
I20260812 11:22:40.987128 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:40.980283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:47539 (local address 127.0.0.1:42123)
0812 11:22:40.980503 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:40.980510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:40.980865 (+ 355us) server_negotiation.cc:407] Connection header received
0812 11:22:40.981080 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:40.981084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:40.981149 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:40.981227 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:40.981898 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.982805 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.984332 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:40.984787 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:40.984957 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:40.986211 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:40.986217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:40.986220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:40.986240 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:40.986293 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:40.986310 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:40.986438 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:40.986706 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 11:22:40.986765 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 11:22:40.987092 18136 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb8c811a2214d108a7ffe33806eb307; no voters:
I20260812 11:22:40.987870 18136 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:40.987987 18157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:40.990731 18136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:40.993261 18157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [term 1 LEADER]: Becoming Leader. State: Replica: 9eb8c811a2214d108a7ffe33806eb307, State: Running, Role: LEADER
I20260812 11:22:40.993995 18157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } }
I20260812 11:22:40.998347 18159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb8c811a2214d108a7ffe33806eb307. Latest consensus state: current_term: 1 leader_uuid: "9eb8c811a2214d108a7ffe33806eb307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } } }
I20260812 11:22:40.999284 18159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:40.998317 18158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eb8c811a2214d108a7ffe33806eb307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb8c811a2214d108a7ffe33806eb307" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42123 } } }
I20260812 11:22:40.999787 18158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307 [sys.catalog]: This master's current role is: LEADER
W20260812 11:22:41.008659 18181 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:22:41.008793 18181 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:22:41.008972 18184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:41.011322 18184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:41.020998 18184 catalog_manager.cc:1347] Generated new cluster ID: 804f557360ef4293901fe0501c300b08
I20260812 11:22:41.021370 18184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:41.042153 18184 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:41.044137 18184 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:41.052788 18184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eb8c811a2214d108a7ffe33806eb307: Generated new TSK 0
I20260812 11:22:41.053795 18184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:41.069717 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18041
W20260812 11:22:41.071053 18130 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.136:56509
W20260812 11:22:41.071965 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18041: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:41.072131 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18041
W20260812 11:22:41.101996 18017 connection.cc:535] client connection to 127.0.0.1:42123 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42123): Connection reset by peer (error 104)
2026-08-12T11:22:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2280 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:41 dist-test-slave-7kzw krb5kdc[18191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:41 dist-test-slave-7kzw krb5kdc[18191](info): set up 2 sockets
Aug 12 11:22:41 dist-test-slave-7kzw krb5kdc[18191](info): commencing operation
krb5kdc: starting...
W20260812 11:22:42.450618 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.329s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:42 dist-test-slave-7kzw krb5kdc[18191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:42.779834 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45599
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:43.137779 18214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:43.138088 18214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:43.138259 18214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:43.145748 18214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:43.145872 18214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:43.145972 18214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:43.146081 18214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:43.146166 18214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:43.156325 18214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:43.157704 18214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:43.159106 18214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:43.172204 18222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:43.172254 18225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:43.172221 18223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:43.173169 18214 server_base.cc:1034] running on GCE node
I20260812 11:22:43.174014 18214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:43.175622 18214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:43.176874 18214 hybrid_clock.cc:648] HybridClock initialized: now 1786533763176837 us; error 46 us; skew 500 ppm
I20260812 11:22:43.177255 18214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:43 dist-test-slave-7kzw krb5kdc[18191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533763, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:43.185585 18214 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:43.187458 18214 webserver.cc:460] Webserver started at http://127.0.0.1:40961/ using document root <none> and password file <none>
I20260812 11:22:43.188247 18214 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:43.188416 18214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:43.188761 18214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:43.192116 18214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "e89da29d744e4c61812147df0057449d"
format_stamp: "Formatted at 2026-08-12 11:22:43 on dist-test-slave-7kzw"
server_key: "c65efdaa61be470fed3ce0233d8942d5"
server_key_iv: "205aef090c54b9921fef4e9b8a3baff8"
server_key_version: "encryptionkey@0"
I20260812 11:22:43.192958 18214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "e89da29d744e4c61812147df0057449d"
format_stamp: "Formatted at 2026-08-12 11:22:43 on dist-test-slave-7kzw"
server_key: "c65efdaa61be470fed3ce0233d8942d5"
server_key_iv: "205aef090c54b9921fef4e9b8a3baff8"
server_key_version: "encryptionkey@0"
I20260812 11:22:43.198422 18214 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 11:22:43.202594 18239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:43.204053 18214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:43.204282 18214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "e89da29d744e4c61812147df0057449d"
format_stamp: "Formatted at 2026-08-12 11:22:43 on dist-test-slave-7kzw"
server_key: "c65efdaa61be470fed3ce0233d8942d5"
server_key_iv: "205aef090c54b9921fef4e9b8a3baff8"
server_key_version: "encryptionkey@0"
I20260812 11:22:43.204511 18214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:43.210903 18214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:43.215646 18214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:43.215966 18214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:43.234208 18214 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45599
I20260812 11:22:43.234247 18318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45599 every 8 connection(s)
I20260812 11:22:43.235703 18214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:43.239811 18319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:43.242698 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18214
I20260812 11:22:43.242908 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:43.243412 16019 external_mini_cluster.cc:1428] Setting key ec74d7804b946d25c716ca0917a368ff
I20260812 11:22:43.252722 18326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:43.245681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:44021 (local address 127.0.0.1:45599)
0812 11:22:43.246736 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:43.246749 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:43.246800 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:22:43.248772 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:43.248800 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:43.249235 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:43.249651 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:43.250848 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:43.250855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:43.250870 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:43.250887 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:43.250954 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:43.250981 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:43.251200 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:43.251331 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 11:22:43.251644 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":479,"threads_started":1}
I20260812 11:22:43.253032 18319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d: Bootstrap starting.
I20260812 11:22:43.256845 18319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:43.257292 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:43.257993 18319 log.cc:824] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:43.261097 18319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d: No bootstrap required, opened a new log
I20260812 11:22:43.266126 18326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:43.263153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:56013 (local address 127.0.0.1:45599)
0812 11:22:43.263354 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:43.263365 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:43.263824 (+ 459us) server_negotiation.cc:407] Connection header received
0812 11:22:43.263993 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:43.264003 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:43.264073 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:43.264192 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:43.265322 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:43.265328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:43.265332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:43.265352 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:43.265401 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:43.265421 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:43.265541 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:43.265722 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 11:22:43.265817 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:22:43.270125 18319 raft_consensus.cc:348] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } }
I20260812 11:22:43.270663 18319 raft_consensus.cc:374] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:43.270789 18319 raft_consensus.cc:729] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89da29d744e4c61812147df0057449d, State: Initialized, Role: FOLLOWER
I20260812 11:22:43.271483 18319 consensus_queue.cc:260] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } }
I20260812 11:22:43.271744 18319 raft_consensus.cc:388] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:43.271896 18319 raft_consensus.cc:482] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:43.272079 18319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:43.274401 18319 raft_consensus.cc:504] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } }
I20260812 11:22:43.275034 18319 leader_election.cc:302] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e89da29d744e4c61812147df0057449d; no voters:
I20260812 11:22:43.275666 18319 leader_election.cc:288] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:43.275847 18338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:43.276582 18338 raft_consensus.cc:686] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [term 1 LEADER]: Becoming Leader. State: Replica: e89da29d744e4c61812147df0057449d, State: Running, Role: LEADER
I20260812 11:22:43.277172 18338 consensus_queue.cc:237] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } }
I20260812 11:22:43.277951 18319 sys_catalog.cc:564] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:43.280436 18344 sys_catalog.cc:455] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e89da29d744e4c61812147df0057449d. Latest consensus state: current_term: 1 leader_uuid: "e89da29d744e4c61812147df0057449d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } } }
I20260812 11:22:43.280947 18344 sys_catalog.cc:458] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:43.281534 18339 sys_catalog.cc:455] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e89da29d744e4c61812147df0057449d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e89da29d744e4c61812147df0057449d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45599 } } }
I20260812 11:22:43.281889 18339 sys_catalog.cc:458] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:43.283063 18354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:43.291661 18354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:43.302697 18354 catalog_manager.cc:1347] Generated new cluster ID: 4fe079af5dcc4ff48d46f587b30c95f8
I20260812 11:22:43.302838 18354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:43.316111 18354 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:43.316642 18354 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:43.327142 18354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e89da29d744e4c61812147df0057449d: Generated new TSK 0
I20260812 11:22:43.328003 18354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:43.334829 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18214
W20260812 11:22:43.336011 18309 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.136:44021
W20260812 11:22:43.336776 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18214: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:43.336937 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18214
2026-08-12T11:22:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2266 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:43 dist-test-slave-7kzw krb5kdc[18379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:43 dist-test-slave-7kzw krb5kdc[18379](info): set up 2 sockets
Aug 12 11:22:43 dist-test-slave-7kzw krb5kdc[18379](info): commencing operation
krb5kdc: starting...
W20260812 11:22:44.768909 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.381s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:44 dist-test-slave-7kzw krb5kdc[18379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:45.100029 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:45.459753 18398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:45.460074 18398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:45.460240 18398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:45.467747 18398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:45.467885 18398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:45.467975 18398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:45.468072 18398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:45.468174 18398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:45.478595 18398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43635
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:45.480100 18398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:45.481530 18398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:45.494601 18404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:45.494580 18407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:45.494629 18405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:45.495391 18398 server_base.cc:1034] running on GCE node
I20260812 11:22:45.496418 18398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:45.498108 18398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:45.499382 18398 hybrid_clock.cc:648] HybridClock initialized: now 1786533765499278 us; error 85 us; skew 500 ppm
I20260812 11:22:45.499922 18398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:45 dist-test-slave-7kzw krb5kdc[18379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533765, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:45.503957 18398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:45.505743 18398 webserver.cc:460] Webserver started at http://127.0.0.1:37485/ using document root <none> and password file <none>
I20260812 11:22:45.506559 18398 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:45.506714 18398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:45.507063 18398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:45.510380 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "0b8570eaa10d44c9a7cbbc1e33315890"
format_stamp: "Formatted at 2026-08-12 11:22:45 on dist-test-slave-7kzw"
server_key: "cccaafe8de75f2dc9fbadfbb364f5570"
server_key_iv: "8b6cf1a630813252b61b6d4d5bd1216e"
server_key_version: "encryptionkey@0"
I20260812 11:22:45.511343 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "0b8570eaa10d44c9a7cbbc1e33315890"
format_stamp: "Formatted at 2026-08-12 11:22:45 on dist-test-slave-7kzw"
server_key: "cccaafe8de75f2dc9fbadfbb364f5570"
server_key_iv: "8b6cf1a630813252b61b6d4d5bd1216e"
server_key_version: "encryptionkey@0"
I20260812 11:22:45.517076 18398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:22:45.520884 18414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:45.522320 18398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:22:45.522563 18398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "0b8570eaa10d44c9a7cbbc1e33315890"
format_stamp: "Formatted at 2026-08-12 11:22:45 on dist-test-slave-7kzw"
server_key: "cccaafe8de75f2dc9fbadfbb364f5570"
server_key_iv: "8b6cf1a630813252b61b6d4d5bd1216e"
server_key_version: "encryptionkey@0"
I20260812 11:22:45.522784 18398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:45.535554 18398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:45.539861 18398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:45.540151 18398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:45.560083 18398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43635
I20260812 11:22:45.560140 18498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43635 every 8 connection(s)
I20260812 11:22:45.561563 18398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:45.562721 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18398
I20260812 11:22:45.562927 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:45.563501 16019 external_mini_cluster.cc:1428] Setting key e6e085c2f45fd8f6b590f5911c657f5a
I20260812 11:22:45.566646 18499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:22:45 dist-test-slave-7kzw krb5kdc[18379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:22:45.578086 18499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890: Bootstrap starting.
I20260812 11:22:45.582062 18499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:45.583281 18499 log.cc:824] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:45.586205 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:45.565465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:46001 (local address 127.0.0.1:43635)
0812 11:22:45.566224 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:45.566253 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:45.566294 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:22:45.568048 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:45.568070 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:45.568449 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:45.568840 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:45.570346 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:45.571754 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:45.573018 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:45.573700 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:45.573893 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:45.578626 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:45.578635 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:45.578650 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:45.578695 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:45.581806 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:45.582746 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:45.582754 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:45.582762 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:45.582934 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:45.583442 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:45.583454 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:45.583456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:45.583977 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:45.584374 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:45.584891 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 11:22:45.585214 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":336,"threads_started":1}
I20260812 11:22:45.586681 18499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890: No bootstrap required, opened a new log
I20260812 11:22:45.590281 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:45.595296 18499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } }
I20260812 11:22:45.595816 18499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:45.595950 18499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b8570eaa10d44c9a7cbbc1e33315890, State: Initialized, Role: FOLLOWER
I20260812 11:22:45.596580 18499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } }
I20260812 11:22:45.596836 18499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:45.596997 18499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:45.597177 18499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:45.600152 18499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } }
I20260812 11:22:45.600863 18499 leader_election.cc:302] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b8570eaa10d44c9a7cbbc1e33315890; no voters:
I20260812 11:22:45.601619 18499 leader_election.cc:288] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:45.601747 18511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:45.603041 18511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [term 1 LEADER]: Becoming Leader. State: Replica: 0b8570eaa10d44c9a7cbbc1e33315890, State: Running, Role: LEADER
I20260812 11:22:45.603714 18511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } }
I20260812 11:22:45.604471 18499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:45.607126 18514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } } }
I20260812 11:22:45.607650 18514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:45.611850 18519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b8570eaa10d44c9a7cbbc1e33315890. Latest consensus state: current_term: 1 leader_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8570eaa10d44c9a7cbbc1e33315890" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43635 } } }
I20260812 11:22:45.612843 18519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:45.614020 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:45.594968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:41803 (local address 127.0.0.1:43635)
0812 11:22:45.595177 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:45.595183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:45.595559 (+ 376us) server_negotiation.cc:407] Connection header received
0812 11:22:45.595696 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:45.595701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:45.595803 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:45.595920 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:45.597671 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:45.598978 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:45.600253 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:45.600943 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:45.601079 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:45.604077 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:45.604088 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:45.604091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:45.604128 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:45.608040 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:45.609402 (+ 1362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:45.609410 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:45.609416 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:45.609681 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:45.610500 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:45.610507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:45.610513 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:45.611053 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:45.612948 (+ 1895us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:45.613178 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 11:22:45.613446 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:22:45.618705 18523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:45.626701 18523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:45.637784 18523 catalog_manager.cc:1347] Generated new cluster ID: 5f6b79895e97467b85454168df60fb0d
I20260812 11:22:45.637924 18523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:45.662041 18523 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:45.664383 18523 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:45.673353 18523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b8570eaa10d44c9a7cbbc1e33315890: Generated new TSK 0
I20260812 11:22:45.674332 18523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:45.693513 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18398
I20260812 11:22:45.694702 18488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:45.793502 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18398
W20260812 11:22:45.820639 18374 connection.cc:535] client connection to 127.0.0.1:43635 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43635): Connection reset by peer (error 104)
2026-08-12T11:22:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:45 dist-test-slave-7kzw krb5kdc[18549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:45 dist-test-slave-7kzw krb5kdc[18549](info): set up 2 sockets
Aug 12 11:22:45 dist-test-slave-7kzw krb5kdc[18549](info): commencing operation
krb5kdc: starting...
W20260812 11:22:47.235544 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.395s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:47 dist-test-slave-7kzw krb5kdc[18549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:47.570434 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43861
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:47.943588 18566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:47.943959 18566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:47.944129 18566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:47.951783 18566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:47.951936 18566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:47.952031 18566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:47.952138 18566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:47.952212 18566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:47.962517 18566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43861
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:47.963941 18566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:47.965333 18566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:47.978142 18578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:47.978191 18576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:47.978163 18574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:47.979213 18566 server_base.cc:1034] running on GCE node
I20260812 11:22:47.980126 18566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:47.981743 18566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:47.982986 18566 hybrid_clock.cc:648] HybridClock initialized: now 1786533767982931 us; error 50 us; skew 500 ppm
I20260812 11:22:47.983390 18566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:47 dist-test-slave-7kzw krb5kdc[18549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533767, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:47.986696 18566 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:47.988297 18566 webserver.cc:460] Webserver started at http://127.0.0.1:46295/ using document root <none> and password file <none>
I20260812 11:22:47.989046 18566 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:47.989214 18566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:47.989558 18566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:47.992763 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "b1cdd31563e448199fc94005a1f038b5"
format_stamp: "Formatted at 2026-08-12 11:22:47 on dist-test-slave-7kzw"
server_key: "f578b05f669373145591391dd2d4d1a6"
server_key_iv: "e1aea185e29c22d8b8d40e4535b7d4f8"
server_key_version: "encryptionkey@0"
I20260812 11:22:47.993597 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "b1cdd31563e448199fc94005a1f038b5"
format_stamp: "Formatted at 2026-08-12 11:22:47 on dist-test-slave-7kzw"
server_key: "f578b05f669373145591391dd2d4d1a6"
server_key_iv: "e1aea185e29c22d8b8d40e4535b7d4f8"
server_key_version: "encryptionkey@0"
I20260812 11:22:47.999208 18566 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:22:48.002940 18588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:48.004369 18566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:22:48.004581 18566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "b1cdd31563e448199fc94005a1f038b5"
format_stamp: "Formatted at 2026-08-12 11:22:47 on dist-test-slave-7kzw"
server_key: "f578b05f669373145591391dd2d4d1a6"
server_key_iv: "e1aea185e29c22d8b8d40e4535b7d4f8"
server_key_version: "encryptionkey@0"
I20260812 11:22:48.004794 18566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:48.022547 18566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:48.027014 18566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:48.027364 18566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:48.047755 18566 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43861
I20260812 11:22:48.047802 18681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43861 every 8 connection(s)
I20260812 11:22:48.049213 18566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:48.053460 18683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:48.053471 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18566
I20260812 11:22:48.053671 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:48.054155 16019 external_mini_cluster.cc:1428] Setting key df529a754cb9593e7fbb1337f8fefb8c
I20260812 11:22:48.067930 18683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5: Bootstrap starting.
I20260812 11:22:48.068416 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:48.055987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:47831 (local address 127.0.0.1:43861)
0812 11:22:48.056874 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:48.056886 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:48.056927 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:22:48.058698 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:48.058722 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:48.059146 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:48.059503 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:48.060201 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:48.061644 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:48.063664 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:48.064401 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:48.064549 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:48.065907 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:48.065915 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:48.065928 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:48.066564 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:48.066650 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:48.066676 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:48.066813 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:48.067093 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 11:22:48.067326 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":390,"threads_started":1}
I20260812 11:22:48.071835 18683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:48.072515 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:48.073060 18683 log.cc:824] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:48.075886 18683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5: No bootstrap required, opened a new log
I20260812 11:22:48.084401 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:48.077186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:55457 (local address 127.0.0.1:43861)
0812 11:22:48.077373 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:48.077379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:48.077822 (+ 443us) server_negotiation.cc:407] Connection header received
0812 11:22:48.077982 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:48.077987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:48.078085 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:48.078203 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:48.078814 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:48.080003 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:48.081365 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:48.082111 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:48.082248 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:48.083520 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:48.083526 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:48.083531 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:48.083556 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:48.083607 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:48.083630 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:48.083743 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:48.083958 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:22:48.084010 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:22:48.085685 18683 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260812 11:22:48.086052 18683 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:48.086155 18683 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1cdd31563e448199fc94005a1f038b5, State: Initialized, Role: FOLLOWER
I20260812 11:22:48.086835 18683 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260812 11:22:48.087093 18683 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:48.087248 18683 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:48.087453 18683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:48.089742 18683 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260812 11:22:48.090276 18683 leader_election.cc:302] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1cdd31563e448199fc94005a1f038b5; no voters:
I20260812 11:22:48.090914 18683 leader_election.cc:288] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:48.091045 18698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:48.091774 18698 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [term 1 LEADER]: Becoming Leader. State: Replica: b1cdd31563e448199fc94005a1f038b5, State: Running, Role: LEADER
I20260812 11:22:48.092353 18698 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260812 11:22:48.093130 18683 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:48.095351 18699 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1cdd31563e448199fc94005a1f038b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } } }
I20260812 11:22:48.095755 18699 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:48.096364 18700 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1cdd31563e448199fc94005a1f038b5. Latest consensus state: current_term: 1 leader_uuid: "b1cdd31563e448199fc94005a1f038b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1cdd31563e448199fc94005a1f038b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } } }
I20260812 11:22:48.097117 18700 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:48.098716 18704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:48.103664 18704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:48.113348 18704 catalog_manager.cc:1347] Generated new cluster ID: af240f7c4a9b4166807635c49e5c541d
I20260812 11:22:48.113480 18704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:48.160645 18704 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:48.162629 18704 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:48.172317 18704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1cdd31563e448199fc94005a1f038b5: Generated new TSK 0
I20260812 11:22:48.173161 18704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:48.180676 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18566
W20260812 11:22:48.181927 18675 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.136:47831
W20260812 11:22:48.183008 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18566: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:48.183547 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18566
W20260812 11:22:48.213233 18545 connection.cc:535] client connection to 127.0.0.1:43861 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43861): Connection reset by peer (error 104)
2026-08-12T11:22:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:48 dist-test-slave-7kzw krb5kdc[18724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:48 dist-test-slave-7kzw krb5kdc[18724](info): set up 2 sockets
Aug 12 11:22:48 dist-test-slave-7kzw krb5kdc[18724](info): commencing operation
krb5kdc: starting...
W20260812 11:22:49.556628 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:49 dist-test-slave-7kzw krb5kdc[18724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:22:49.874585 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:50.235169 18750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:50.235565 18750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:50.235757 18750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:50.243148 18750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:50.243335 18750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:50.243449 18750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:50.243561 18750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:50.243650 18750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:50.254041 18750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45321
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:50.255550 18750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:50.256974 18750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:50.270270 18757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:50.270107 18763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:50.270146 18760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:50.270925 18750 server_base.cc:1034] running on GCE node
I20260812 11:22:50.271929 18750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:50.273523 18750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:50.274744 18750 hybrid_clock.cc:648] HybridClock initialized: now 1786533770274691 us; error 40 us; skew 500 ppm
I20260812 11:22:50.275194 18750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:50 dist-test-slave-7kzw krb5kdc[18724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533770, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:50.278918 18750 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:22:50.280884 18750 webserver.cc:460] Webserver started at http://127.0.0.1:35269/ using document root <none> and password file <none>
I20260812 11:22:50.281633 18750 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:50.281764 18750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:50.282038 18750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:50.285238 18750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "5e5a935172124611b8a80dc1f545385a"
format_stamp: "Formatted at 2026-08-12 11:22:50 on dist-test-slave-7kzw"
server_key: "91856eb359751c5d4d37f3b6ba535bf1"
server_key_iv: "5e7c045eae0fff408d3455710f8e46ed"
server_key_version: "encryptionkey@0"
I20260812 11:22:50.285995 18750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "5e5a935172124611b8a80dc1f545385a"
format_stamp: "Formatted at 2026-08-12 11:22:50 on dist-test-slave-7kzw"
server_key: "91856eb359751c5d4d37f3b6ba535bf1"
server_key_iv: "5e7c045eae0fff408d3455710f8e46ed"
server_key_version: "encryptionkey@0"
I20260812 11:22:50.291759 18750 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:22:50.295497 18776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:50.297010 18750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:50.297215 18750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "5e5a935172124611b8a80dc1f545385a"
format_stamp: "Formatted at 2026-08-12 11:22:50 on dist-test-slave-7kzw"
server_key: "91856eb359751c5d4d37f3b6ba535bf1"
server_key_iv: "5e7c045eae0fff408d3455710f8e46ed"
server_key_version: "encryptionkey@0"
I20260812 11:22:50.297432 18750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:50.303797 18750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:50.308228 18750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:50.308552 18750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:50.329140 18750 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45321
I20260812 11:22:50.329237 18860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45321 every 8 connection(s)
I20260812 11:22:50.330704 18750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:50.335273 18862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:50.338402 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18750
I20260812 11:22:50.338685 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:50.339202 16019 external_mini_cluster.cc:1428] Setting key bbaf4499735f3677671dd99c907971db
I20260812 11:22:50.349256 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:50.341318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:41669 (local address 127.0.0.1:45321)
0812 11:22:50.342220 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:50.342237 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:50.342292 (+ 55us) server_negotiation.cc:407] Connection header received
0812 11:22:50.344911 (+ 2619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:50.344946 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:50.345455 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:50.345933 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:50.347063 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:50.347073 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:50.347093 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:50.347115 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:50.347202 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:50.347238 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:50.347510 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:50.347687 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 11:22:50.347915 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":343,"threads_started":1}
I20260812 11:22:50.350519 18862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a: Bootstrap starting.
I20260812 11:22:50.353127 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:50.354343 18862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:50.355813 18862 log.cc:824] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:50.359134 18862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a: No bootstrap required, opened a new log
I20260812 11:22:50.361987 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:50.359351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:39467 (local address 127.0.0.1:45321)
0812 11:22:50.359564 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:50.359570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:50.359941 (+ 371us) server_negotiation.cc:407] Connection header received
0812 11:22:50.360079 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:50.360083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:50.360138 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:50.360229 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:50.361263 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:50.361268 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:50.361271 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:50.361290 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:50.361332 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:50.361346 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:50.361448 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:50.361584 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:22:50.361639 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:22:50.368472 18862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 11:22:50.368892 18862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:50.369019 18862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e5a935172124611b8a80dc1f545385a, State: Initialized, Role: FOLLOWER
I20260812 11:22:50.369582 18862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 11:22:50.369837 18862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:50.369992 18862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:50.370182 18862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:50.372558 18862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 11:22:50.373106 18862 leader_election.cc:302] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e5a935172124611b8a80dc1f545385a; no voters:
I20260812 11:22:50.373935 18862 leader_election.cc:288] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:50.374063 18883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:50.375312 18883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [term 1 LEADER]: Becoming Leader. State: Replica: 5e5a935172124611b8a80dc1f545385a, State: Running, Role: LEADER
I20260812 11:22:50.375849 18883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 11:22:50.376183 18862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:50.378814 18886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e5a935172124611b8a80dc1f545385a. Latest consensus state: current_term: 1 leader_uuid: "5e5a935172124611b8a80dc1f545385a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260812 11:22:50.378913 18884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e5a935172124611b8a80dc1f545385a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e5a935172124611b8a80dc1f545385a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260812 11:22:50.379225 18886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:50.379304 18884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:50.383535 18892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:50.388936 18892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:50.398097 18892 catalog_manager.cc:1347] Generated new cluster ID: a5badea2c5164e97a6e1fd08b6a2dbce
I20260812 11:22:50.398241 18892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:50.409968 18892 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:50.410547 18892 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:50.417960 18892 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e5a935172124611b8a80dc1f545385a: Generated new TSK 0
I20260812 11:22:50.418982 18892 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:50.424531 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18750
W20260812 11:22:50.426007 18852 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.136:41669
W20260812 11:22:50.426797 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18750: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:50.426937 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18750
2026-08-12T11:22:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2237 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:50 dist-test-slave-7kzw krb5kdc[18921](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:50 dist-test-slave-7kzw krb5kdc[18921](info): set up 2 sockets
Aug 12 11:22:50 dist-test-slave-7kzw krb5kdc[18921](info): commencing operation
krb5kdc: starting...
W20260812 11:22:51.864811 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.395s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:52 dist-test-slave-7kzw krb5kdc[18921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:52.186335 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:34859
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:40991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:34859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:52.549587 18944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:52.549902 18944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:52.549997 18944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:52.557391 18944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:52.557510 18944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:52.557574 18944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:52.557637 18944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:52.557690 18944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:52.568074 18944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:40991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:34859
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:34859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:52.569500 18944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:52.570938 18944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:52.583943 18950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:52.583843 18951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:52.583874 18955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:52.585021 18944 server_base.cc:1034] running on GCE node
I20260812 11:22:52.585922 18944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:52.587544 18944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:52.588798 18944 hybrid_clock.cc:648] HybridClock initialized: now 1786533772588728 us; error 56 us; skew 500 ppm
I20260812 11:22:52.589212 18944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:52 dist-test-slave-7kzw krb5kdc[18921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533772, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:52.592717 18944 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:52.594398 18944 webserver.cc:460] Webserver started at http://127.15.164.254:38373/ using document root <none> and password file <none>
I20260812 11:22:52.595177 18944 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:52.595335 18944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:52.595664 18944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:52.598981 18944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "d4963f98bbd44c068f95cbc26a75ecf5"
format_stamp: "Formatted at 2026-08-12 11:22:52 on dist-test-slave-7kzw"
server_key: "9678f8f5915e0868a23c2ddc5be1e7ae"
server_key_iv: "6a50d907c684e24facad5e86a630286b"
server_key_version: "encryptionkey@0"
I20260812 11:22:52.599797 18944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "d4963f98bbd44c068f95cbc26a75ecf5"
format_stamp: "Formatted at 2026-08-12 11:22:52 on dist-test-slave-7kzw"
server_key: "9678f8f5915e0868a23c2ddc5be1e7ae"
server_key_iv: "6a50d907c684e24facad5e86a630286b"
server_key_version: "encryptionkey@0"
I20260812 11:22:52.605177 18944 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:22:52.608834 18972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:52.610141 18944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:22:52.610353 18944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "d4963f98bbd44c068f95cbc26a75ecf5"
format_stamp: "Formatted at 2026-08-12 11:22:52 on dist-test-slave-7kzw"
server_key: "9678f8f5915e0868a23c2ddc5be1e7ae"
server_key_iv: "6a50d907c684e24facad5e86a630286b"
server_key_version: "encryptionkey@0"
I20260812 11:22:52.610616 18944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:52.629132 18944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:52.633710 18944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:52.634025 18944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:52.654021 18944 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:34859
I20260812 11:22:52.654043 19054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:34859 every 8 connection(s)
I20260812 11:22:52.655462 18944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:52.659046 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 18944
I20260812 11:22:52.659296 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:52.659847 16019 external_mini_cluster.cc:1428] Setting key bc52d2dfbb742242881607f671cbcd84
I20260812 11:22:52.659850 19056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:52.676225 19056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5: Bootstrap starting.
Aug 12 11:22:52 dist-test-slave-7kzw krb5kdc[18921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:52.680177 19056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:52.681519 19056 log.cc:824] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:52.685364 19056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5: No bootstrap required, opened a new log
I20260812 11:22:52.686537 19059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:52.661853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45117 (local address 127.15.164.254:34859)
0812 11:22:52.662791 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:52.662812 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:52.662868 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:22:52.665359 (+ 2491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:52.665391 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:52.665946 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:52.666440 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:52.667912 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:52.670184 (+ 2272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:52.671586 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:52.672820 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:52.673062 (+ 242us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:52.677942 (+ 4880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:52.677951 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:52.677966 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:52.678016 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:52.681308 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:52.682607 (+ 1299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:52.682620 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:52.682635 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:52.682878 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:52.683450 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:52.683454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:52.683457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:52.684016 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:52.684323 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:52.684951 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 11:22:52.685336 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":367,"threads_started":1}
I20260812 11:22:52.690586 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:52.693753 19056 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } }
I20260812 11:22:52.694154 19056 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:52.694260 19056 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4963f98bbd44c068f95cbc26a75ecf5, State: Initialized, Role: FOLLOWER
I20260812 11:22:52.695008 19056 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } }
I20260812 11:22:52.695396 19056 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:52.695554 19056 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:52.695763 19056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:52.698134 19056 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } }
I20260812 11:22:52.698747 19056 leader_election.cc:302] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4963f98bbd44c068f95cbc26a75ecf5; no voters:
I20260812 11:22:52.699443 19056 leader_election.cc:288] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:52.699600 19069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:52.701122 19069 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [term 1 LEADER]: Becoming Leader. State: Replica: d4963f98bbd44c068f95cbc26a75ecf5, State: Running, Role: LEADER
I20260812 11:22:52.701972 19056 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:52.701826 19069 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } }
I20260812 11:22:52.708003 19071 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } } }
I20260812 11:22:52.708938 19071 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:52.708612 19072 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4963f98bbd44c068f95cbc26a75ecf5. Latest consensus state: current_term: 1 leader_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4963f98bbd44c068f95cbc26a75ecf5" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 34859 } } }
I20260812 11:22:52.709554 19072 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:52.716589 19059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:52.695196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33425 (local address 127.15.164.254:34859)
0812 11:22:52.695463 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:52.695472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:52.696061 (+ 589us) server_negotiation.cc:407] Connection header received
0812 11:22:52.696265 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:52.696270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:52.696338 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:52.696454 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:52.697896 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:52.698802 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:52.700871 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:52.701605 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:52.701765 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:52.705488 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:52.705498 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:52.705505 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:52.705559 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:52.711049 (+ 5490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:52.712321 (+ 1272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:52.712330 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:52.712336 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:52.712546 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:52.713236 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:52.713245 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:52.713251 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:52.713860 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:52.715606 (+ 1746us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:52.715845 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:22:52.716083 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:22:52.719542 19085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:52.725329 19085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:52.735270 19085 catalog_manager.cc:1347] Generated new cluster ID: 4458f3c8460a4d01ad02776e3823473a
I20260812 11:22:52.735412 19085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:52.754879 19085 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:52.756839 19085 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:52.765421 19085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4963f98bbd44c068f95cbc26a75ecf5: Generated new TSK 0
I20260812 11:22:52.766299 19085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:52.782441 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 18944
I20260812 11:22:52.783744 19045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:52.879309 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 18944
W20260812 11:22:52.906824 18915 connection.cc:535] client connection to 127.15.164.254:34859 recv error: Network error: failed to read from TLS socket (remote: 127.15.164.254:34859): Connection reset by peer (error 104)
2026-08-12T11:22:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:53 dist-test-slave-7kzw krb5kdc[19101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:53 dist-test-slave-7kzw krb5kdc[19101](info): set up 2 sockets
Aug 12 11:22:53 dist-test-slave-7kzw krb5kdc[19101](info): commencing operation
krb5kdc: starting...
W20260812 11:22:54.259023 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:54 dist-test-slave-7kzw krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:54.586882 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35685
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:35405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:35685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:54.947950 19124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:54.948340 19124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:54.948513 19124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:54.955825 19124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:54.956012 19124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:54.956131 19124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:54.956269 19124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:54.956351 19124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:54.966661 19124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:35405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:35685
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:35685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:54.968129 19124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:54.969535 19124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:54.982846 19130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:54.982874 19132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:54.982897 19136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:54.983929 19124 server_base.cc:1034] running on GCE node
I20260812 11:22:54.984825 19124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:54.986340 19124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:54.987596 19124 hybrid_clock.cc:648] HybridClock initialized: now 1786533774987560 us; error 71 us; skew 500 ppm
I20260812 11:22:54.987989 19124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:54 dist-test-slave-7kzw krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533774, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:54.997051 19124 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:54.998865 19124 webserver.cc:460] Webserver started at http://127.15.164.254:36651/ using document root <none> and password file <none>
I20260812 11:22:54.999671 19124 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:54.999835 19124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:55.000173 19124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:55.003469 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "b84a7612d2d348669cdcb43bdd5a5c34"
format_stamp: "Formatted at 2026-08-12 11:22:54 on dist-test-slave-7kzw"
server_key: "eb7113a8e15542caa40f099b76c438da"
server_key_iv: "42306a945243bcdeb9645bebf9bb6f38"
server_key_version: "encryptionkey@0"
I20260812 11:22:55.004309 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "b84a7612d2d348669cdcb43bdd5a5c34"
format_stamp: "Formatted at 2026-08-12 11:22:54 on dist-test-slave-7kzw"
server_key: "eb7113a8e15542caa40f099b76c438da"
server_key_iv: "42306a945243bcdeb9645bebf9bb6f38"
server_key_version: "encryptionkey@0"
I20260812 11:22:55.010139 19124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 11:22:55.013933 19147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:55.015429 19124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:55.015636 19124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "b84a7612d2d348669cdcb43bdd5a5c34"
format_stamp: "Formatted at 2026-08-12 11:22:54 on dist-test-slave-7kzw"
server_key: "eb7113a8e15542caa40f099b76c438da"
server_key_iv: "42306a945243bcdeb9645bebf9bb6f38"
server_key_version: "encryptionkey@0"
I20260812 11:22:55.015851 19124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:55.069679 19124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:55.074887 19124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:55.075228 19124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:55.096000 19124 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:35685
I20260812 11:22:55.096024 19224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:35685 every 8 connection(s)
I20260812 11:22:55.097496 19124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:55.101577 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19124
I20260812 11:22:55.101749 19225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:55.101787 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:55.102350 16019 external_mini_cluster.cc:1428] Setting key c15b3982cb7f68e08e2523b15cee12f0
I20260812 11:22:55.116384 19225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34: Bootstrap starting.
I20260812 11:22:55.116997 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:55.104310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53079 (local address 127.15.164.254:35685)
0812 11:22:55.105271 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:55.105283 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:55.105332 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:22:55.107170 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:55.107198 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:55.107619 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:55.107993 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:55.108613 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:55.110120 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:55.112027 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:55.112836 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:55.112993 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:55.114380 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:55.114388 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:55.114401 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:55.115041 (+ 640us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:55.115122 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:55.115153 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:55.115278 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:55.115782 (+ 504us) server_negotiation.cc:299] Negotiation successful
0812 11:22:55.115979 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":462,"threads_started":1}
I20260812 11:22:55.120565 19225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:55.121769 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:55.122016 19225 log.cc:824] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:55.125679 19225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34: No bootstrap required, opened a new log
I20260812 11:22:55.135283 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:55.127592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49423 (local address 127.15.164.254:35685)
0812 11:22:55.127816 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:55.127824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:55.128197 (+ 373us) server_negotiation.cc:407] Connection header received
0812 11:22:55.128371 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:55.128379 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:55.128472 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:55.128608 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:55.129224 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:55.130544 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:55.132139 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:55.132931 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:55.133090 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:55.134329 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:55.134336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:55.134341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:55.134366 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:55.134436 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:55.134490 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:55.134624 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:55.134806 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 11:22:55.134871 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:22:55.137064 19225 raft_consensus.cc:348] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } }
I20260812 11:22:55.137470 19225 raft_consensus.cc:374] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:55.137562 19225 raft_consensus.cc:729] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b84a7612d2d348669cdcb43bdd5a5c34, State: Initialized, Role: FOLLOWER
I20260812 11:22:55.138106 19225 consensus_queue.cc:260] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } }
I20260812 11:22:55.138336 19225 raft_consensus.cc:388] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:55.138445 19225 raft_consensus.cc:482] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:55.138674 19225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:55.140998 19225 raft_consensus.cc:504] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } }
I20260812 11:22:55.141865 19225 leader_election.cc:302] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b84a7612d2d348669cdcb43bdd5a5c34; no voters:
I20260812 11:22:55.142429 19225 leader_election.cc:288] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:55.142675 19246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:55.143550 19246 raft_consensus.cc:686] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [term 1 LEADER]: Becoming Leader. State: Replica: b84a7612d2d348669cdcb43bdd5a5c34, State: Running, Role: LEADER
I20260812 11:22:55.144150 19246 consensus_queue.cc:237] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } }
I20260812 11:22:55.145069 19225 sys_catalog.cc:564] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:55.147362 19249 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } } }
I20260812 11:22:55.147393 19251 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b84a7612d2d348669cdcb43bdd5a5c34. Latest consensus state: current_term: 1 leader_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84a7612d2d348669cdcb43bdd5a5c34" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 35685 } } }
I20260812 11:22:55.147878 19249 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:55.147887 19251 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:55.149590 19257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:55.155556 19257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:55.165159 19257 catalog_manager.cc:1347] Generated new cluster ID: cf8a9c4e759b473bb1fb9c3fd3afb926
I20260812 11:22:55.165279 19257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:55.184964 19257 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:55.186906 19257 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:55.201164 19257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b84a7612d2d348669cdcb43bdd5a5c34: Generated new TSK 0
I20260812 11:22:55.202433 19257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:55.213008 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19124
W20260812 11:22:55.215087 19215 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53079
W20260812 11:22:55.215975 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19124: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:55.216162 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19124
W20260812 11:22:55.242597 19098 connection.cc:535] client connection to 127.15.164.254:35685 recv error: Network error: failed to read from TLS socket (remote: 127.15.164.254:35685): Connection reset by peer (error 104)
2026-08-12T11:22:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:55 dist-test-slave-7kzw krb5kdc[19281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:55 dist-test-slave-7kzw krb5kdc[19281](info): set up 2 sockets
Aug 12 11:22:55 dist-test-slave-7kzw krb5kdc[19281](info): commencing operation
krb5kdc: starting...
W20260812 11:22:56.587356 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:56 dist-test-slave-7kzw krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:56.916193 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33419
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:33419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:57.299849 19303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:57.300139 19303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:57.300304 19303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:57.307792 19303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:57.307909 19303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:57.307997 19303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:57.308115 19303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:57.308185 19303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:57.318185 19303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:33419
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:33419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:57.319626 19303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:57.321002 19303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:57.333511 19312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:57.333545 19309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:57.333463 19314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:57.334455 19303 server_base.cc:1034] running on GCE node
I20260812 11:22:57.335433 19303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:57.336970 19303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:57.338260 19303 hybrid_clock.cc:648] HybridClock initialized: now 1786533777338212 us; error 57 us; skew 500 ppm
I20260812 11:22:57.338732 19303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:57 dist-test-slave-7kzw krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533777, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:57.342043 19303 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:57.343852 19303 webserver.cc:460] Webserver started at http://127.15.164.254:34171/ using document root <none> and password file <none>
I20260812 11:22:57.344632 19303 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:57.344810 19303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:57.345170 19303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:57.348659 19303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "c538b1489c0a47d999c0cf9076089467"
format_stamp: "Formatted at 2026-08-12 11:22:57 on dist-test-slave-7kzw"
server_key: "2b5a14f3a77b76edf8fefe01eb70e5b2"
server_key_iv: "8e1f9e21ffbf5424278fa36480e206bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:57.349553 19303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "c538b1489c0a47d999c0cf9076089467"
format_stamp: "Formatted at 2026-08-12 11:22:57 on dist-test-slave-7kzw"
server_key: "2b5a14f3a77b76edf8fefe01eb70e5b2"
server_key_iv: "8e1f9e21ffbf5424278fa36480e206bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:57.355270 19303 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:22:57.359261 19327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:57.360743 19303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:22:57.360955 19303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "c538b1489c0a47d999c0cf9076089467"
format_stamp: "Formatted at 2026-08-12 11:22:57 on dist-test-slave-7kzw"
server_key: "2b5a14f3a77b76edf8fefe01eb70e5b2"
server_key_iv: "8e1f9e21ffbf5424278fa36480e206bb"
server_key_version: "encryptionkey@0"
I20260812 11:22:57.361148 19303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:57.368002 19303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:57.372937 19303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:57.373274 19303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:57.392499 19303 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:33419
I20260812 11:22:57.392530 19407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:33419 every 8 connection(s)
I20260812 11:22:57.393951 19303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:57.397802 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:57.400383 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19303
I20260812 11:22:57.400602 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:57.401153 16019 external_mini_cluster.cc:1428] Setting key 01703ed98d515cc7d2d4d42bc15acf98
I20260812 11:22:57.409884 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:57.403190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54171 (local address 127.15.164.254:33419)
0812 11:22:57.404201 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:57.404214 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:57.404259 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:22:57.406046 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:57.406071 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:57.406417 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:57.406886 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:57.408098 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:57.408106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:57.408125 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:57.408144 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:57.408222 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:57.408249 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:57.408461 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:57.408588 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 11:22:57.408885 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":517,"threads_started":1}
I20260812 11:22:57.410867 19409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467: Bootstrap starting.
I20260812 11:22:57.414031 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:57.414222 19409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:57.415518 19409 log.cc:824] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:57.419085 19409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467: No bootstrap required, opened a new log
I20260812 11:22:57.422533 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:57.419662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41813 (local address 127.15.164.254:33419)
0812 11:22:57.419892 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:57.419902 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:57.420462 (+ 560us) server_negotiation.cc:407] Connection header received
0812 11:22:57.420680 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:57.420685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:57.420743 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:57.420866 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:57.421811 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:57.421817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:57.421822 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:22:57.421848 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:57.421891 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:22:57.421910 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:57.422044 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:57.422146 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 11:22:57.422210 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:22:57.427426 19409 raft_consensus.cc:348] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } }
I20260812 11:22:57.427814 19409 raft_consensus.cc:374] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:57.427933 19409 raft_consensus.cc:729] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538b1489c0a47d999c0cf9076089467, State: Initialized, Role: FOLLOWER
I20260812 11:22:57.428529 19409 consensus_queue.cc:260] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } }
I20260812 11:22:57.428776 19409 raft_consensus.cc:388] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:57.428946 19409 raft_consensus.cc:482] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:57.429108 19409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:57.431419 19409 raft_consensus.cc:504] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } }
I20260812 11:22:57.432051 19409 leader_election.cc:302] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c538b1489c0a47d999c0cf9076089467; no voters:
I20260812 11:22:57.432745 19409 leader_election.cc:288] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:57.432859 19426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:57.433583 19426 raft_consensus.cc:686] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [term 1 LEADER]: Becoming Leader. State: Replica: c538b1489c0a47d999c0cf9076089467, State: Running, Role: LEADER
I20260812 11:22:57.434175 19426 consensus_queue.cc:237] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } }
I20260812 11:22:57.434954 19409 sys_catalog.cc:564] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:57.437070 19427 sys_catalog.cc:455] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c538b1489c0a47d999c0cf9076089467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } } }
I20260812 11:22:57.437757 19427 sys_catalog.cc:458] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:57.437100 19428 sys_catalog.cc:455] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c538b1489c0a47d999c0cf9076089467. Latest consensus state: current_term: 1 leader_uuid: "c538b1489c0a47d999c0cf9076089467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c538b1489c0a47d999c0cf9076089467" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 33419 } } }
I20260812 11:22:57.438313 19428 sys_catalog.cc:458] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467 [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:57.438782 19440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:57.444664 19440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:57.453651 19440 catalog_manager.cc:1347] Generated new cluster ID: 3fefb23e1c484b1e84631fcc78c46297
I20260812 11:22:57.453764 19440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:57.477541 19440 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:57.478080 19440 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:57.496150 19440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c538b1489c0a47d999c0cf9076089467: Generated new TSK 0
I20260812 11:22:57.497375 19440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:57.504634 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19303
W20260812 11:22:57.506237 19402 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54171
W20260812 11:22:57.507207 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19303: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:22:57.507403 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19303
2026-08-12T11:22:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:22:57 dist-test-slave-7kzw krb5kdc[19460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:22:57 dist-test-slave-7kzw krb5kdc[19460](info): set up 2 sockets
Aug 12 11:22:57 dist-test-slave-7kzw krb5kdc[19460](info): commencing operation
krb5kdc: starting...
W20260812 11:22:58.883124 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.326s user 0.006s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:22:59 dist-test-slave-7kzw krb5kdc[19460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:22:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:22:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:22:59.216105 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41899
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:22:59.567569 19479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:22:59.567963 19479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:22:59.568120 19479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:22:59.575407 19479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:22:59.575572 19479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:22:59.575688 19479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:22:59.575798 19479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:22:59.575875 19479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:22:59.585775 19479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:22:59.587218 19479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:22:59.588583 19479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:22:59.601317 19486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:59.601424 19491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:22:59.601261 19487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:22:59.603109 19479 server_base.cc:1034] running on GCE node
I20260812 11:22:59.603981 19479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:22:59.605553 19479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:22:59.606827 19479 hybrid_clock.cc:648] HybridClock initialized: now 1786533779606762 us; error 56 us; skew 500 ppm
I20260812 11:22:59.607213 19479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:22:59 dist-test-slave-7kzw krb5kdc[19460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533779, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:22:59.610616 19479 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:22:59.612293 19479 webserver.cc:460] Webserver started at http://127.15.164.254:37659/ using document root <none> and password file <none>
I20260812 11:22:59.612980 19479 fs_manager.cc:359] Metadata directory not provided
I20260812 11:22:59.613087 19479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:22:59.613361 19479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:22:59.616489 19479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c"
format_stamp: "Formatted at 2026-08-12 11:22:59 on dist-test-slave-7kzw"
server_key: "c571c29efeaebd8d547761de67e4a0a4"
server_key_iv: "29384edad94b5330fca935966a2d5817"
server_key_version: "encryptionkey@0"
I20260812 11:22:59.617316 19479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c"
format_stamp: "Formatted at 2026-08-12 11:22:59 on dist-test-slave-7kzw"
server_key: "c571c29efeaebd8d547761de67e4a0a4"
server_key_iv: "29384edad94b5330fca935966a2d5817"
server_key_version: "encryptionkey@0"
I20260812 11:22:59.622622 19479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 11:22:59.626268 19498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:22:59.627862 19479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:22:59.628113 19479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c"
format_stamp: "Formatted at 2026-08-12 11:22:59 on dist-test-slave-7kzw"
server_key: "c571c29efeaebd8d547761de67e4a0a4"
server_key_iv: "29384edad94b5330fca935966a2d5817"
server_key_version: "encryptionkey@0"
I20260812 11:22:59.628341 19479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:22:59.644176 19479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:22:59.648747 19479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:22:59.649053 19479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:22:59.671917 19479 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41899
I20260812 11:22:59.671941 19580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41899 every 8 connection(s)
I20260812 11:22:59.673355 19479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:22:59.677356 19581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:22:59.678004 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19479
I20260812 11:22:59.678188 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:22:59.678723 16019 external_mini_cluster.cc:1428] Setting key ef5be8b4d48497a77e5d4bf44dce8a8e
I20260812 11:22:59.691746 19581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c: Bootstrap starting.
Aug 12 11:22:59 dist-test-slave-7kzw krb5kdc[19460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:22:59.695554 19581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c: Neither blocks nor log segments found. Creating new log.
I20260812 11:22:59.696820 19581 log.cc:824] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:22:59.699816 19581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c: No bootstrap required, opened a new log
I20260812 11:22:59.703362 19585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:59.680516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60607 (local address 127.15.164.254:41899)
0812 11:22:59.681333 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:59.681347 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:59.681387 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:22:59.683398 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:59.683421 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:59.683798 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:59.684124 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:59.686064 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:59.687436 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:59.689288 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:59.689924 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:59.690052 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:59.695106 (+ 5054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:59.695121 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:59.695136 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:59.695182 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:59.698701 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:59.699447 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:59.699454 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:59.699462 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:59.699655 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:59.700124 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:59.700130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:59.700138 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:59.700739 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:59.701101 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:59.701645 (+ 544us) server_negotiation.cc:299] Negotiation successful
0812 11:22:59.702167 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":369,"threads_started":1}
I20260812 11:22:59.707666 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:22:59.708707 19581 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } }
I20260812 11:22:59.709116 19581 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:22:59.709220 19581 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf97cc6e3bb49a3b02cdb33d0405d4c, State: Initialized, Role: FOLLOWER
I20260812 11:22:59.709852 19581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } }
I20260812 11:22:59.710153 19581 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:22:59.710307 19581 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:22:59.710539 19581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:22:59.714017 19581 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } }
I20260812 11:22:59.714689 19581 leader_election.cc:302] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cf97cc6e3bb49a3b02cdb33d0405d4c; no voters:
I20260812 11:22:59.715394 19581 leader_election.cc:288] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:22:59.715503 19596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:22:59.716459 19596 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [term 1 LEADER]: Becoming Leader. State: Replica: 1cf97cc6e3bb49a3b02cdb33d0405d4c, State: Running, Role: LEADER
I20260812 11:22:59.717494 19596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } }
I20260812 11:22:59.718513 19581 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:22:59.720844 19599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cf97cc6e3bb49a3b02cdb33d0405d4c. Latest consensus state: current_term: 1 leader_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } } }
I20260812 11:22:59.721350 19599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:59.726135 19600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cf97cc6e3bb49a3b02cdb33d0405d4c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41899 } } }
I20260812 11:22:59.726688 19600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c [sys.catalog]: This master's current role is: LEADER
I20260812 11:22:59.735369 19585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:22:59.712994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36303 (local address 127.15.164.254:41899)
0812 11:22:59.713203 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:22:59.713210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:22:59.713504 (+ 294us) server_negotiation.cc:407] Connection header received
0812 11:22:59.713687 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:22:59.713690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:22:59.713751 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:22:59.713843 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:22:59.715994 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:59.718291 (+ 2297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:59.719976 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:22:59.720683 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:22:59.720809 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:22:59.724748 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:22:59.724758 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:22:59.724766 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:22:59.724819 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:22:59.729916 (+ 5097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:59.731084 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:59.731093 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:59.731099 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:59.731284 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:22:59.731925 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:22:59.731933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:22:59.731939 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:22:59.732546 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:22:59.734281 (+ 1735us) server_negotiation.cc:1035] Waiting for connection context
0812 11:22:59.734536 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 11:22:59.734846 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:22:59.736122 19610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:22:59.743569 19610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:22:59.754082 19610 catalog_manager.cc:1347] Generated new cluster ID: 1ab536d1ba4b444991b9729d25fc4b43
I20260812 11:22:59.754226 19610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:22:59.764273 19610 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:22:59.765573 19610 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:22:59.771885 19610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1cf97cc6e3bb49a3b02cdb33d0405d4c: Generated new TSK 0
I20260812 11:22:59.772709 19610 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:22:59.779837 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19479
I20260812 11:22:59.781157 19572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:22:59.873581 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19479
2026-08-12T11:22:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:00 dist-test-slave-7kzw krb5kdc[19643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:00 dist-test-slave-7kzw krb5kdc[19643](info): set up 2 sockets
Aug 12 11:23:00 dist-test-slave-7kzw krb5kdc[19643](info): commencing operation
krb5kdc: starting...
W20260812 11:23:01.311046 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.392s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:23:01 dist-test-slave-7kzw krb5kdc[19643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:23:01.637281 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41705
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:45811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:41705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:02.001477 19663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:02.001801 19663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:02.001966 19663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:02.009194 19663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:02.009313 19663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:02.009402 19663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:02.009516 19663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:02.009596 19663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:02.019688 19663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:45811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:41705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:41705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:02.021108 19663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:02.022511 19663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:02.034422 19670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:02.034490 19674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:02.034381 19669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:02.035912 19663 server_base.cc:1034] running on GCE node
I20260812 11:23:02.036840 19663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:02.038430 19663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:02.039742 19663 hybrid_clock.cc:648] HybridClock initialized: now 1786533782039667 us; error 56 us; skew 500 ppm
I20260812 11:23:02.040207 19663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:02 dist-test-slave-7kzw krb5kdc[19643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533782, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:02.047622 19663 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:23:02.049342 19663 webserver.cc:460] Webserver started at http://127.15.164.254:36869/ using document root <none> and password file <none>
I20260812 11:23:02.050130 19663 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:02.050297 19663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:02.050709 19663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:02.054123 19663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "94b9990361dc490aae6b948e940b0d61"
format_stamp: "Formatted at 2026-08-12 11:23:02 on dist-test-slave-7kzw"
server_key: "3752eb161468c7d789202dabecbb0676"
server_key_iv: "25435813084909b320296c158b7c1117"
server_key_version: "encryptionkey@0"
I20260812 11:23:02.055008 19663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "94b9990361dc490aae6b948e940b0d61"
format_stamp: "Formatted at 2026-08-12 11:23:02 on dist-test-slave-7kzw"
server_key: "3752eb161468c7d789202dabecbb0676"
server_key_iv: "25435813084909b320296c158b7c1117"
server_key_version: "encryptionkey@0"
I20260812 11:23:02.060804 19663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:02.064498 19686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:02.065899 19663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:23:02.066114 19663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "94b9990361dc490aae6b948e940b0d61"
format_stamp: "Formatted at 2026-08-12 11:23:02 on dist-test-slave-7kzw"
server_key: "3752eb161468c7d789202dabecbb0676"
server_key_iv: "25435813084909b320296c158b7c1117"
server_key_version: "encryptionkey@0"
I20260812 11:23:02.066354 19663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:02.087283 19663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:02.092103 19663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:02.092417 19663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:02.113210 19663 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:41705
I20260812 11:23:02.113260 19786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:41705 every 8 connection(s)
I20260812 11:23:02.114764 19663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:02.118806 19787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:02.119433 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19663
I20260812 11:23:02.119612 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:23:02.120076 16019 external_mini_cluster.cc:1428] Setting key 1d78c13c3e42edfda30a0781c6912c5c
I20260812 11:23:02.133827 19787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61: Bootstrap starting.
I20260812 11:23:02.136032 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:02.121986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57593 (local address 127.15.164.254:41705)
0812 11:23:02.122847 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:02.122864 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:02.122927 (+ 63us) server_negotiation.cc:407] Connection header received
0812 11:23:02.125661 (+ 2734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:02.125691 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:02.126217 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:02.126713 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:02.127220 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:02.129099 (+ 1879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:02.130685 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:02.131786 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:02.131957 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:02.133134 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:02.133146 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:02.133165 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:23:02.133926 (+ 761us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:02.134027 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:23:02.134060 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:02.134195 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:02.134381 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 11:23:02.134664 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":359,"threads_started":1}
I20260812 11:23:02.137897 19787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:02.139231 19787 log.cc:824] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:02.140074 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:23:02.142453 19787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61: No bootstrap required, opened a new log
I20260812 11:23:02.152242 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:02.145212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42963 (local address 127.15.164.254:41705)
0812 11:23:02.145426 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:02.145435 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:02.146049 (+ 614us) server_negotiation.cc:407] Connection header received
0812 11:23:02.146209 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:02.146213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:02.146272 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:02.146357 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:02.147030 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:02.147760 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:02.149673 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:02.150133 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:02.150229 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:02.151503 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:02.151508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:02.151514 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:23:02.151531 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:02.151572 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:23:02.151586 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:02.151665 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:02.151832 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:23:02.151903 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:23:02.152956 19787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } }
I20260812 11:23:02.153431 19787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:02.153566 19787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94b9990361dc490aae6b948e940b0d61, State: Initialized, Role: FOLLOWER
I20260812 11:23:02.154215 19787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } }
I20260812 11:23:02.154439 19787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:02.154661 19787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:02.154851 19787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:02.157243 19787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } }
I20260812 11:23:02.157748 19787 leader_election.cc:302] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94b9990361dc490aae6b948e940b0d61; no voters:
I20260812 11:23:02.158394 19787 leader_election.cc:288] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:02.158596 19800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:02.159392 19800 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [term 1 LEADER]: Becoming Leader. State: Replica: 94b9990361dc490aae6b948e940b0d61, State: Running, Role: LEADER
I20260812 11:23:02.159971 19800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } }
I20260812 11:23:02.160727 19787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:02.163443 19803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94b9990361dc490aae6b948e940b0d61. Latest consensus state: current_term: 1 leader_uuid: "94b9990361dc490aae6b948e940b0d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } } }
I20260812 11:23:02.163345 19802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94b9990361dc490aae6b948e940b0d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b9990361dc490aae6b948e940b0d61" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 41705 } } }
I20260812 11:23:02.163887 19803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:02.164050 19802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:02.165650 19819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:02.171578 19819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:02.181627 19819 catalog_manager.cc:1347] Generated new cluster ID: 2c120485c8bd464b8079c82013c14148
I20260812 11:23:02.181779 19819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:02.197309 19819 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:02.198743 19819 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:02.205632 19819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94b9990361dc490aae6b948e940b0d61: Generated new TSK 0
I20260812 11:23:02.206513 19819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:02.222173 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19663
W20260812 11:23:02.223405 19778 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57593
W20260812 11:23:02.224133 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19663: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:23:02.224257 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19663
2026-08-12T11:23:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2357 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:02 dist-test-slave-7kzw krb5kdc[19834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:02 dist-test-slave-7kzw krb5kdc[19834](info): set up 2 sockets
Aug 12 11:23:02 dist-test-slave-7kzw krb5kdc[19834](info): commencing operation
krb5kdc: starting...
W20260812 11:23:03.603422 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.002s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:23:03 dist-test-slave-7kzw krb5kdc[19834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:23:03.930140 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:37181
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:43847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:37181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:04.289811 19857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:04.290197 19857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:04.290382 19857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:04.297619 19857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:04.297782 19857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:04.297892 19857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:04.298002 19857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:04.298089 19857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:04.308122 19857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:43847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:37181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:37181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:04.309481 19857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:04.310897 19857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:04.323444 19870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:04.323415 19863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:04.323357 19865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:04.324409 19857 server_base.cc:1034] running on GCE node
I20260812 11:23:04.325214 19857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:04.326681 19857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:04.327922 19857 hybrid_clock.cc:648] HybridClock initialized: now 1786533784327860 us; error 47 us; skew 500 ppm
I20260812 11:23:04.328367 19857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:04 dist-test-slave-7kzw krb5kdc[19834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533784, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:04.331807 19857 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:23:04.333236 19857 webserver.cc:460] Webserver started at http://127.15.164.254:39653/ using document root <none> and password file <none>
I20260812 11:23:04.333881 19857 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:04.333984 19857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:04.334244 19857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:04.337227 19857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "ff279a679d9746d6953f32d8c4eb1486"
format_stamp: "Formatted at 2026-08-12 11:23:04 on dist-test-slave-7kzw"
server_key: "722bb27534689231dabc4fa07d142150"
server_key_iv: "954f62454e0f925386ae752faabca379"
server_key_version: "encryptionkey@0"
I20260812 11:23:04.337941 19857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "ff279a679d9746d6953f32d8c4eb1486"
format_stamp: "Formatted at 2026-08-12 11:23:04 on dist-test-slave-7kzw"
server_key: "722bb27534689231dabc4fa07d142150"
server_key_iv: "954f62454e0f925386ae752faabca379"
server_key_version: "encryptionkey@0"
I20260812 11:23:04.343329 19857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:23:04.346906 19886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:04.348316 19857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:23:04.348464 19857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "ff279a679d9746d6953f32d8c4eb1486"
format_stamp: "Formatted at 2026-08-12 11:23:04 on dist-test-slave-7kzw"
server_key: "722bb27534689231dabc4fa07d142150"
server_key_iv: "954f62454e0f925386ae752faabca379"
server_key_version: "encryptionkey@0"
I20260812 11:23:04.348630 19857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:04.354429 19857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:04.358821 19857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:04.359067 19857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:04.378053 19857 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:37181
I20260812 11:23:04.378093 19964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:37181 every 8 connection(s)
I20260812 11:23:04.379696 19857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:04.381122 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 19857
I20260812 11:23:04.381312 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:23:04.381788 16019 external_mini_cluster.cc:1428] Setting key 5801985f1e42b81bf096658a573e0b7a
I20260812 11:23:04.384768 19968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:04.389978 19973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:04.383949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53237 (local address 127.15.164.254:37181)
0812 11:23:04.384800 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:04.384812 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:04.384855 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:23:04.386596 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:04.386618 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:04.386938 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:04.387255 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:04.388398 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:04.388405 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:04.388417 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:23:04.388444 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:04.388517 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:23:04.388541 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:04.388751 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:04.388850 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 11:23:04.389080 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":368,"threads_started":1}
I20260812 11:23:04.394074 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:23:04.398150 19968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486: Bootstrap starting.
I20260812 11:23:04.401046 19973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:04.398370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57311 (local address 127.15.164.254:37181)
0812 11:23:04.398604 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:04.398610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:04.399145 (+ 535us) server_negotiation.cc:407] Connection header received
0812 11:23:04.399273 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:04.399279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:04.399349 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:04.399469 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:04.400372 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:04.400380 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:04.400391 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:23:04.400412 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:04.400462 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:23:04.400485 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:04.400615 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:04.400663 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 11:23:04.400721 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:23:04.402264 19968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:04.403474 19968 log.cc:824] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:04.406602 19968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486: No bootstrap required, opened a new log
I20260812 11:23:04.414269 19968 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } }
I20260812 11:23:04.414737 19968 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:23:04.414857 19968 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff279a679d9746d6953f32d8c4eb1486, State: Initialized, Role: FOLLOWER
I20260812 11:23:04.415432 19968 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } }
I20260812 11:23:04.415647 19968 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:23:04.415822 19968 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:23:04.416010 19968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:04.418187 19968 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } }
I20260812 11:23:04.418746 19968 leader_election.cc:302] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff279a679d9746d6953f32d8c4eb1486; no voters:
I20260812 11:23:04.419477 19968 leader_election.cc:288] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:23:04.419638 19985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:04.420765 19985 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [term 1 LEADER]: Becoming Leader. State: Replica: ff279a679d9746d6953f32d8c4eb1486, State: Running, Role: LEADER
I20260812 11:23:04.421290 19985 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } }
I20260812 11:23:04.421651 19968 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:04.424259 19987 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff279a679d9746d6953f32d8c4eb1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } } }
I20260812 11:23:04.424227 19988 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff279a679d9746d6953f32d8c4eb1486. Latest consensus state: current_term: 1 leader_uuid: "ff279a679d9746d6953f32d8c4eb1486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff279a679d9746d6953f32d8c4eb1486" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 37181 } } }
I20260812 11:23:04.424755 19988 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:04.424755 19987 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486 [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:04.426940 19993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:04.432215 19993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:04.442085 19993 catalog_manager.cc:1347] Generated new cluster ID: 93c703baf9b742a9a2d118aab43e24e9
I20260812 11:23:04.442260 19993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:04.460178 19993 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:04.460690 19993 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:04.476424 19993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff279a679d9746d6953f32d8c4eb1486: Generated new TSK 0
I20260812 11:23:04.477382 19993 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:04.488102 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19857
W20260812 11:23:04.489451 19960 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53237
W20260812 11:23:04.490172 16019 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 19857: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:23:04.490361 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 19857
2026-08-12T11:23:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2260 ms)
[----------] 18 tests from AuthTokenIssuingTest (42113 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:04 dist-test-slave-7kzw krb5kdc[20018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:04 dist-test-slave-7kzw krb5kdc[20018](info): set up 2 sockets
Aug 12 11:23:04 dist-test-slave-7kzw krb5kdc[20018](info): commencing operation
krb5kdc: starting...
W20260812 11:23:05.882581 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:23:06 dist-test-slave-7kzw krb5kdc[20018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:23:06.206028 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44877
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:06.551287 20036 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:06.551656 20036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:06.551779 20036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:06.551927 20036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:06.559116 20036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:06.559202 20036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:06.559324 20036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:06.559422 20036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:06.559514 20036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:06.569365 20036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:44877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:06.570788 20036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:06.572139 20036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:06.584401 20050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:06.584401 20048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:06.585121 20052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:06.585704 20036 server_base.cc:1034] running on GCE node
I20260812 11:23:06.586627 20036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:06.588140 20036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:06.589402 20036 hybrid_clock.cc:648] HybridClock initialized: now 1786533786589331 us; error 60 us; skew 500 ppm
I20260812 11:23:06.589749 20036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:06 dist-test-slave-7kzw krb5kdc[20018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:06.593344 20036 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:23:06.594959 20036 webserver.cc:460] Webserver started at http://127.15.164.254:34235/ using document root <none> and password file <none>
I20260812 11:23:06.595681 20036 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:06.595813 20036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:06.596138 20036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:06.599179 20036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "3a909915ae594cd2b166a898e743009c"
format_stamp: "Formatted at 2026-08-12 11:23:06 on dist-test-slave-7kzw"
server_key: "37d4892fb58af1fa54fc4709a0c72f1c"
server_key_iv: "7351e753edb4d64776c70ef1debf1774"
server_key_version: "encryptionkey@0"
I20260812 11:23:06.599999 20036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "3a909915ae594cd2b166a898e743009c"
format_stamp: "Formatted at 2026-08-12 11:23:06 on dist-test-slave-7kzw"
server_key: "37d4892fb58af1fa54fc4709a0c72f1c"
server_key_iv: "7351e753edb4d64776c70ef1debf1774"
server_key_version: "encryptionkey@0"
I20260812 11:23:06.605137 20036 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 11:23:06.608860 20062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:06.610348 20036 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:23:06.610617 20036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "3a909915ae594cd2b166a898e743009c"
format_stamp: "Formatted at 2026-08-12 11:23:06 on dist-test-slave-7kzw"
server_key: "37d4892fb58af1fa54fc4709a0c72f1c"
server_key_iv: "7351e753edb4d64776c70ef1debf1774"
server_key_version: "encryptionkey@0"
I20260812 11:23:06.610877 20036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:06.646597 20036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:06.650966 20036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:06.651285 20036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:06.671849 20036 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:44877
I20260812 11:23:06.671868 20152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:44877 every 8 connection(s)
I20260812 11:23:06.673317 20036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:06.677277 20156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:06.677781 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20036
I20260812 11:23:06.678012 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:23:06.678937 16019 external_mini_cluster.cc:1428] Setting key 1dfea3059fa0dbd07ed66d238aed0536
I20260812 11:23:06.687863 20156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:06 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.164.253@KRBTEST.COM; defaulting to no policy
I20260812 11:23:06.713275 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.691894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37860 (local address 127.15.164.254:44877)
0812 11:23:06.693628 (+ 1734us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:06.693636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:06.693693 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:23:06.695272 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:06.695278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:06.695503 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:06.695660 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:06.697329 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:06.698583 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:06.700856 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:06.701395 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:06.701535 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:06.705812 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:06.705820 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:06.705833 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:06.705862 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:06.708789 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:06.709486 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:06.709499 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:06.709501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:06.709660 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:06.710056 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:06.710077 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:06.710079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:06.710683 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:06.710897 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:06.711440 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 11:23:06.711791 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1489,"thread_start_us":1255,"threads_started":1}
I20260812 11:23:06.713312 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.691893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44877 (local address 127.0.0.1:37860)
0812 11:23:06.692775 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.692822 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:06.694864 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:06.695744 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:06.695755 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:06.696581 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:06.697095 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:06.697122 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:06.698741 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:06.698749 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:06.700700 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:06.700719 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:06.701675 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:06.701689 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:06.701929 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:06.702734 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:06.702769 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:06.705587 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:06.708924 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:06.708938 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:06.708951 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:06.709353 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:06.709782 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:06.709787 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:06.709790 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:06.709947 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:06.710838 (+ 891us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:06.710846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:06.711072 (+ 226us) client_negotiation.cc:769] Sending connection context
0812 11:23:06.711330 (+ 258us) client_negotiation.cc:240] Negotiation successful
0812 11:23:06.711911 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":138,"thread_start_us":390,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.253@KRBTEST.COM" created.
I20260812 11:23:06.716661 20156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:06.717847 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.717412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55284)
0812 11:23:06.717596 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.717718 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:23:06.718149 20069 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
I20260812 11:23:06.719874 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.719483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55294)
0812 11:23:06.719681 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.719748 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 11:23:06.720114 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:40933: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
I20260812 11:23:06.749786 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:40933
--webserver_interface=127.15.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:06.769459 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } attempt: 1
I20260812 11:23:06.770870 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.770334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55300)
0812 11:23:06.770605 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.770734 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 11:23:06.771893 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.771539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55310)
0812 11:23:06.771690 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.771767 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 11:23:06.772080 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:40933: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
I20260812 11:23:06.840341 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } attempt: 2
I20260812 11:23:06.841564 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.841048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55326)
0812 11:23:06.841323 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.841413 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:23:06.842641 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.842231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55330)
0812 11:23:06.842393 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.842456 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:23:06.842816 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:40933: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
I20260812 11:23:06.934094 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } attempt: 3
I20260812 11:23:06.935449 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.934930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55346)
0812 11:23:06.935192 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.935293 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 11:23:06.936508 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:06.936141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55356)
0812 11:23:06.936295 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:06.936373 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:23:06.936688 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:40933: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
I20260812 11:23:07.079970 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } attempt: 4
I20260812 11:23:07.081390 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.080758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55362)
0812 11:23:07.081122 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.081236 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260812 11:23:07.082579 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.082116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55364)
0812 11:23:07.082286 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.082383 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:23:07.082769 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:40933: Network error: Client connection negotiation failed: client connection to 127.15.164.253:40933: connect: Connection refused (error 111)
W20260812 11:23:07.112190 20168 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:07.112566 20168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:07.112690 20168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:07.112820 20168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:07.120082 20168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:07.120198 20168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:07.120309 20168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:07.120393 20168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:07.120494 20168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:07.130252 20168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:07.131603 20168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:07.132957 20168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:07.145215 20181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:07.145299 20178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:07.145262 20175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:07.146044 20168 server_base.cc:1034] running on GCE node
I20260812 11:23:07.147027 20168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:07.148427 20168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:07.149690 20168 hybrid_clock.cc:648] HybridClock initialized: now 1786533787149625 us; error 37 us; skew 500 ppm
I20260812 11:23:07.150051 20168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:07.158581 20168 init.cc:377] Logged in from keytab as kudu/127.15.164.253@KRBTEST.COM (short username kudu)
I20260812 11:23:07.160094 20168 webserver.cc:460] Webserver started at http://127.15.164.253:36401/ using document root <none> and password file <none>
I20260812 11:23:07.160831 20168 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:07.160951 20168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:07.161309 20168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:07.164824 20168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data/instance:
uuid: "962a2b79a1a4485f8e2e6d2b206b722d"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "a60456b4bcc0d7b4d2fcab6cfd69526c"
server_key_iv: "0d8461ded2e1b2b33bdb5cac2b3f1aa5"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.165658 20168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal/instance:
uuid: "962a2b79a1a4485f8e2e6d2b206b722d"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "a60456b4bcc0d7b4d2fcab6cfd69526c"
server_key_iv: "0d8461ded2e1b2b33bdb5cac2b3f1aa5"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.171159 20168 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:23:07.175136 20199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:07.176529 20168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:23:07.176741 20168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "962a2b79a1a4485f8e2e6d2b206b722d"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "a60456b4bcc0d7b4d2fcab6cfd69526c"
server_key_iv: "0d8461ded2e1b2b33bdb5cac2b3f1aa5"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.176968 20168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:07.189240 20168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:07.193404 20168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:07.193696 20168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:07.213083 20168 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.253:40933
I20260812 11:23:07.213107 20287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.253:40933 every 8 connection(s)
I20260812 11:23:07.214730 20168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
I20260812 11:23:07.218729 20289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:07.222443 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20168
I20260812 11:23:07.222676 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-1/wal/instance
I20260812 11:23:07.223233 16019 external_mini_cluster.cc:1428] Setting key 8c2e7c9e96eafd9ef8d68146d7437846
I20260812 11:23:07.227288 20289 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:07.261166 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.230804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37862 (local address 127.15.164.254:44877)
0812 11:23:07.231578 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.231586 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.232917 (+ 1331us) server_negotiation.cc:407] Connection header received
0812 11:23:07.235959 (+ 3042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.235967 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.236074 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.236167 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.238668 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.239983 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.242646 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.243457 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.243620 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.252176 (+ 8556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.252186 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.252193 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.252258 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.256484 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.257552 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.257559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.257565 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.257756 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.258386 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.258392 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.258396 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.258866 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.259024 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.260254 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.260557 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":376,"threads_started":1}
WARNING: no policy specified for kudu/127.15.164.252@KRBTEST.COM; defaulting to no policy
I20260812 11:23:07.264231 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.231615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44877 (local address 127.0.0.1:37862)
0812 11:23:07.232680 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.232765 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.235630 (+ 2865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.236735 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.236749 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.237550 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.238363 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.238392 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.240219 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.240225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.242403 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.242421 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.243747 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.243756 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.244081 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.248283 (+ 4202us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.248308 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.251834 (+ 3526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.256667 (+ 4833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.256679 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.256703 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.257400 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.257923 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.257930 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.257936 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.258226 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.259142 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.259150 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.259706 (+ 556us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.261597 (+ 1891us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.262316 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":388,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.252@KRBTEST.COM" created.
I20260812 11:23:07.266364 20289 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:07.283814 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.267445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55378)
0812 11:23:07.267668 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.267691 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.267805 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.268696 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.268704 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.269239 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.269451 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.269466 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.271351 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.271358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.272392 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.272404 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.273669 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.273674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.273846 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.274553 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.274601 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.277130 (+ 2529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.280757 (+ 3627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.280763 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.280767 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.281236 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.281809 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.281814 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.281818 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.281960 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.282744 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.282748 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.282887 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.283036 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.283338 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:23:07.283862 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.267510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55378 (local address 127.15.164.253:40933)
0812 11:23:07.268281 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.268287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.268315 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:23:07.268365 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.268371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.268544 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.268669 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.269650 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.271203 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.272591 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.273512 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.273650 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.277344 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.277356 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.277371 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.277401 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.280614 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.281469 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.281479 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.281485 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.281666 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.282065 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.282072 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.282076 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.282592 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.282817 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.283193 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.283455 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":614,"thread_start_us":445,"threads_started":1}
I20260812 11:23:07.287055 20289 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:07.288285 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.287844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49650)
0812 11:23:07.288018 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.288133 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:23:07.288520 20202 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.290482 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.289929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49666)
0812 11:23:07.290206 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.290308 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260812 11:23:07.290701 20289 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
I20260812 11:23:07.313939 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:43841
--webserver_interface=127.15.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:07.340025 20289 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 1
I20260812 11:23:07.341161 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.340694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49678)
0812 11:23:07.340904 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.341009 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:23:07.342140 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.341794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49688)
0812 11:23:07.341966 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.342043 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:23:07.342383 20289 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.382045 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } attempt: 5
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:07.396703 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.382902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55386)
0812 11:23:07.383102 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.383126 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.383242 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.383592 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.383596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.384010 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.384198 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.384207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.385587 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.385591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.386589 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.386602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.387578 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.387583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.387735 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.388396 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.388414 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.390540 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.394301 (+ 3761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.394306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.394309 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.394760 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.395189 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.395192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.395195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.395346 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.395957 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.395961 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.396086 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.396210 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.396454 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:23:07.396962 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.383015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.15.164.253:40933)
0812 11:23:07.383247 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.383253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.383280 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:23:07.383349 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.383354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.383438 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.383569 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.384363 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.385453 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.386755 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.387429 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.387573 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.390752 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.390761 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.390769 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.390816 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.394165 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.394889 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.394894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.394898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.395055 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.395470 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.395475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.395478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.395835 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.395988 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.396387 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.396652 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 11:23:07.398083 20156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:07.399101 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.398727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49692)
0812 11:23:07.398892 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.398975 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:23:07.400061 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.399709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49702)
0812 11:23:07.399878 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.399947 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 11:23:07.400312 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.410581 20289 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 2
I20260812 11:23:07.411715 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.411282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49712)
0812 11:23:07.411466 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.411564 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 11:23:07.412679 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.412346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49720)
0812 11:23:07.412495 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.412570 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 11:23:07.412899 20289 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.451547 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 1
I20260812 11:23:07.452909 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.452324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49734)
0812 11:23:07.452572 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.452694 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:23:07.454005 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.453618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49742)
0812 11:23:07.453776 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.453867 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 11:23:07.454274 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.504132 20289 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 3
I20260812 11:23:07.505396 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.504864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49748)
0812 11:23:07.505091 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.505219 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:23:07.506675 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.506135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49756)
0812 11:23:07.506398 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.506525 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
W20260812 11:23:07.506970 20289 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.522539 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 2
I20260812 11:23:07.523928 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.523267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49762)
0812 11:23:07.523549 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.523679 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:23:07.525032 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.524651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49766)
0812 11:23:07.524817 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.524902 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:23:07.525314 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.631608 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 3
I20260812 11:23:07.633003 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.632404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49768)
0812 11:23:07.632663 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.632782 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 11:23:07.634229 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.633775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49770)
0812 11:23:07.633969 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.634083 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:23:07.634485 20156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
I20260812 11:23:07.650223 20289 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 4
I20260812 11:23:07.651484 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.650893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49780)
0812 11:23:07.651172 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.651283 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:23:07.652606 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.652228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49794)
0812 11:23:07.652386 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.652479 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:23:07.652838 20289 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:43841: Network error: Client connection negotiation failed: client connection to 127.15.164.252:43841: connect: Connection refused (error 111)
W20260812 11:23:07.669235 20300 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:07.669610 20300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:07.669749 20300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:07.669899 20300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:07.678009 20300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:07.678182 20300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:07.678375 20300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:07.678490 20300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:07.678601 20300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:07.688957 20300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:44877,127.15.164.253:40933,127.15.164.252:43841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:43841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:07.690263 20300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:07.691699 20300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:07.704442 20313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:07.704406 20307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:07.704509 20306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:07.708294 20300 server_base.cc:1034] running on GCE node
I20260812 11:23:07.709241 20300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:07.710983 20300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:07.712268 20300 hybrid_clock.cc:648] HybridClock initialized: now 1786533787712185 us; error 50 us; skew 500 ppm
I20260812 11:23:07.712666 20300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:07.716391 20300 init.cc:377] Logged in from keytab as kudu/127.15.164.252@KRBTEST.COM (short username kudu)
I20260812 11:23:07.718070 20300 webserver.cc:460] Webserver started at http://127.15.164.252:35445/ using document root <none> and password file <none>
I20260812 11:23:07.718962 20300 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:07.719115 20300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:07.719468 20300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:07.722741 20300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data/instance:
uuid: "6e152f392683429d9820d1d383d89a75"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "811182a2d10fd86f785b0391307fccc4"
server_key_iv: "b1b8e737d9d9fecabdb6a889d9c45e56"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.723665 20300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal/instance:
uuid: "6e152f392683429d9820d1d383d89a75"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "811182a2d10fd86f785b0391307fccc4"
server_key_iv: "b1b8e737d9d9fecabdb6a889d9c45e56"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.729321 20300 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 11:23:07.732970 20324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:07.734413 20300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:23:07.734654 20300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "6e152f392683429d9820d1d383d89a75"
format_stamp: "Formatted at 2026-08-12 11:23:07 on dist-test-slave-7kzw"
server_key: "811182a2d10fd86f785b0391307fccc4"
server_key_iv: "b1b8e737d9d9fecabdb6a889d9c45e56"
server_key_version: "encryptionkey@0"
I20260812 11:23:07.734886 20300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:07.753654 20300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:07.758283 20300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:07.758616 20300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:07.777613 20300 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.252:43841
I20260812 11:23:07.777639 20403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.252:43841 every 8 connection(s)
I20260812 11:23:07.779142 20300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
I20260812 11:23:07.783172 20404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:07.785094 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20300
I20260812 11:23:07.785306 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786533397360424-16019-0/minicluster-data/master-2/wal/instance
I20260812 11:23:07.785748 16019 external_mini_cluster.cc:1428] Setting key ab3ba888fb25f245527129bb1a55e6ee
I20260812 11:23:07.790931 20404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:07.809732 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.793339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37870 (local address 127.15.164.254:44877)
0812 11:23:07.793938 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.793945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.794499 (+ 554us) server_negotiation.cc:407] Connection header received
0812 11:23:07.794663 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.794667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.794731 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.794832 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.795960 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.796811 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.798617 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.799336 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.799490 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.803335 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.803339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.803343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.803375 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.806554 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.807405 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.807408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.807411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.807581 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.808018 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.808025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.808028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.808379 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.808530 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.809281 (+ 751us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.809449 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":255,"threads_started":1}
I20260812 11:23:07.810011 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.793379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:44877 (local address 127.0.0.1:37870)
0812 11:23:07.794323 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.794374 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.794544 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.794922 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.794929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.795551 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.795798 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.795808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.796975 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.796981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.798416 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.798429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.799551 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.799556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.799679 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.800288 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.800310 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.803133 (+ 2823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.806668 (+ 3535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.806681 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.806692 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.807250 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.807709 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.807714 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.807718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.807863 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.808693 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.808700 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.808919 (+ 219us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.809124 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.809481 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":475,"threads_started":1}
I20260812 11:23:07.810149 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.787897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49802 (local address 127.15.164.252:43841)
0812 11:23:07.788700 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.788712 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.788753 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:23:07.790436 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.790517 (+ 81us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.790912 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.791306 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.792810 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.794920 (+ 2110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.796437 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.797247 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.797464 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.802000 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.802013 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.802030 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.802073 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.805065 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.805940 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.805947 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.805954 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.806116 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.806600 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.806603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.806605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.807440 (+ 835us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.807686 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.808153 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.808530 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":336,"threads_started":1}
I20260812 11:23:07.811703 20156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 4
I20260812 11:23:07.811811 20404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:07.827975 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.812297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49814)
0812 11:23:07.812598 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.812618 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.812725 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.813409 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.813413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.813901 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.814143 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.814154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.815409 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.815414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.817004 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.817021 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.818006 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.818012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.818201 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.819003 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.819032 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.821837 (+ 2805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.825303 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.825309 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.825312 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.825757 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.826180 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.826185 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.826189 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.826329 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.826902 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.826907 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.827072 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.827246 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.827557 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":66}
I20260812 11:23:07.828130 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.812962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:40933 (local address 127.0.0.1:55396)
0812 11:23:07.813129 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.813145 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.813240 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.813918 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.813922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.814358 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.814610 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.814622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.816026 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.816033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.817238 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.817250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.817931 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.817937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.818141 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.818822 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.818847 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.821274 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.825197 (+ 3923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.825210 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.825216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.825781 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.826266 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.826272 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.826277 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.826507 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.827192 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.827199 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.827386 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.827526 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.827783 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":23}
I20260812 11:23:07.828188 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.812943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.15.164.253:40933)
0812 11:23:07.813131 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.813144 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.813628 (+ 484us) server_negotiation.cc:407] Connection header received
0812 11:23:07.813709 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.813714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.813796 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.813894 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.814767 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.815891 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.817371 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.817789 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.817924 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.821480 (+ 3556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.821487 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.821492 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.821535 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.825057 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.825927 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.825932 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.825936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.826104 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.826666 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.826671 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.826675 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.827054 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.827213 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.827681 (+ 468us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.827862 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:23:07.828785 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.812497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.15.164.252:43841)
0812 11:23:07.812676 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.812682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.812698 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:23:07.812839 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.812843 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.812925 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.813369 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.814293 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.815277 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.817156 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.817831 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.818538 (+ 707us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.822042 (+ 3504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.822051 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.822058 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.822102 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.825161 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.825922 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.825928 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.825932 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.826061 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.826447 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.826452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.826456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.826778 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.826933 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.828430 (+ 1497us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.828578 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":61}
I20260812 11:23:07.829134 20404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:07.833937 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.813487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37884 (local address 127.15.164.254:44877)
0812 11:23:07.813782 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.813788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.813803 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:23:07.813851 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.813856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.813942 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.814040 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.815784 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.816865 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.818612 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.819256 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.819410 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.825497 (+ 6087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.825504 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.825509 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.825553 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.830503 (+ 4950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.831380 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.831385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.831389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.831548 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.831996 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.832002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.832005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.832395 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.832715 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.833079 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.833334 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":170}
I20260812 11:23:07.835668 20156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: Bootstrap starting.
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
I20260812 11:23:07.840072 20156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:07.841466 20156 log.cc:824] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:07.844323 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.829885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49816)
0812 11:23:07.830057 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.830078 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.830172 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.830750 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.830752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.831062 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.831181 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.831188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.832158 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.832166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.833506 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.833524 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.834361 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.834367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:07.834627 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.835215 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:07.835237 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:07.837471 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:07.840918 (+ 3447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.840924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.840928 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.841434 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.842597 (+ 1163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:07.842601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:07.842603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:07.842741 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:07.843314 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:07.843319 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:07.843488 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 11:23:07.843651 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 11:23:07.843954 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:23:07.844594 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.830192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49816 (local address 127.15.164.252:43841)
0812 11:23:07.830367 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.830372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.830389 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:23:07.830437 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.830441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.830536 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.830626 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.831325 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.832024 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.833681 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.834222 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.834341 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.837660 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.837666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.837671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.837707 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.840791 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.841621 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.841630 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.841636 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.841767 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.842873 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.842877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.842881 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.843193 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.843374 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.843767 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.844141 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":59}
I20260812 11:23:07.845333 20156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: No bootstrap required, opened a new log
Aug 12 11:23:07 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:07.850605 20404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: Bootstrap starting.
I20260812 11:23:07.854203 20156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:07.854601 20156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a909915ae594cd2b166a898e743009c, State: Initialized, Role: FOLLOWER
I20260812 11:23:07.854909 20404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:07.855154 20156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:07.856098 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.836088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55398 (local address 127.15.164.253:40933)
0812 11:23:07.836284 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.836290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.836538 (+ 248us) server_negotiation.cc:407] Connection header received
0812 11:23:07.836670 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.836679 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.836762 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.836867 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.838594 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.839964 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.841892 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.842610 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.842744 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.848558 (+ 5814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.848565 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.848570 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.848614 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.852538 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.853410 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.853416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.853420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.853626 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:07.854111 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:07.854116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:07.854120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:07.854559 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:07.854872 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:07.855311 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 11:23:07.855687 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 11:23:07.856594 20404 log.cc:824] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:07.857702 20414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:07.858623 20414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:07.859150 20156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:07.861599 20404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: No bootstrap required, opened a new log
I20260812 11:23:07.862166 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:23:07.865726 20115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3a909915ae594cd2b166a898e743009c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37884
I20260812 11:23:07.866330 20115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:23:07.866588 20115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:07.872486 20115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:07.873227 20404 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:07.873682 20404 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e152f392683429d9820d1d383d89a75, State: Initialized, Role: FOLLOWER
I20260812 11:23:07.874212 20115 leader_election.cc:288] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [CANDIDATE]: Term 1 election: Requested vote from peers 962a2b79a1a4485f8e2e6d2b206b722d (127.15.164.253:40933), 6e152f392683429d9820d1d383d89a75 (127.15.164.252:43841)
I20260812 11:23:07.874243 20404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:07.878823 20434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:07.879313 20434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:07.881093 20404 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:07.882261 20365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a909915ae594cd2b166a898e743009c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6e152f392683429d9820d1d383d89a75"
I20260812 11:23:07.882946 20365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:07.887766 20365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a909915ae594cd2b166a898e743009c in term 1.
I20260812 11:23:07.888531 20069 leader_election.cc:302] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a909915ae594cd2b166a898e743009c, 6e152f392683429d9820d1d383d89a75; no voters:
I20260812 11:23:07.889144 20414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:07.894593 20414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [term 1 LEADER]: Becoming Leader. State: Replica: 3a909915ae594cd2b166a898e743009c, State: Running, Role: LEADER
I20260812 11:23:07.895417 20414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
W20260812 11:23:07.904315 20076 tablet.cc:2369] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:07.915311 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a909915ae594cd2b166a898e743009c. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:07.915761 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:07.889629 20036 master_runner.cc:186] Error getting master registration for 127.15.164.253:40933: OK, instance_id { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" instance_seqno: 1786533787207712 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:07.922729 20036 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:23:07.926954 20436 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:07.927479 20436 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:07.929744 20451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:07.940116 20451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:23:07.952046 20289 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } attempt: 5
I20260812 11:23:07.976279 20365 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [term 1 FOLLOWER]: Refusing update from remote peer 3a909915ae594cd2b166a898e743009c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:07.977631 20414 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:08.005203 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.931461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37896 (local address 127.15.164.254:44877)
0812 11:23:07.931685 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.931694 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.951028 (+ 19334us) server_negotiation.cc:407] Connection header received
0812 11:23:07.952512 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.952520 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.952623 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.952703 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.965729 (+ 13026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.967104 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.977409 (+ 10305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.978165 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.978278 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.992313 (+ 14035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.992324 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.992333 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.992394 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.997551 (+ 5157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.000922 (+ 3371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.000929 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.000933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.001118 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.002501 (+ 1383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.002511 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.002518 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.003064 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:08.003436 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.004483 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.004765 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:23:08.007894 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.949807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49832 (local address 127.15.164.252:43841)
0812 11:23:07.950004 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.950010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.961954 (+ 11944us) server_negotiation.cc:407] Connection header received
0812 11:23:07.962264 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.962271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.962393 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.962527 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.974041 (+ 11514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.975283 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.982630 (+ 7347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.983668 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.983842 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.994932 (+ 11090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.994940 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.994945 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.994990 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.999267 (+ 4277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.000889 (+ 1622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.000898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.000904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.001101 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.002244 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.002292 (+ 48us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.002298 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.003363 (+ 1065us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:08.004152 (+ 789us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.005841 (+ 1689us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.006660 (+ 819us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:23:08.009960 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.932187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55412 (local address 127.15.164.253:40933)
0812 11:23:07.932382 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.932389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.949172 (+ 16783us) server_negotiation.cc:407] Connection header received
0812 11:23:07.951562 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.951570 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.951672 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.951761 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.965696 (+ 13935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.967212 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.971403 (+ 4191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.972365 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:07.972530 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:07.984893 (+ 12363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:07.984904 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:07.984912 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:07.984969 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:07.989950 (+ 4981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.001707 (+ 11757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.001715 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.001719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.001929 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.003533 (+ 1604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.003538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.003541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.005450 (+ 1909us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:08.005756 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.009234 (+ 3478us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.009573 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1411,"server-negotiator.queue_time_us":73}
W20260812 11:23:08.010771 20333 tablet.cc:2369] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:08.014146 20434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a909915ae594cd2b166a898e743009c. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.014598 20434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:08.018304 20463 mvcc.cc:205] Tried to move back new op lower bound from 7317642395534757888 to 7317642395226275840. Current Snapshot: MvccSnapshot[applied={T|T < 7317642395534757888}]
I20260812 11:23:08.020892 20469 mvcc.cc:205] Tried to move back new op lower bound from 7317642395534757888 to 7317642395226275840. Current Snapshot: MvccSnapshot[applied={T|T < 7317642395534757888}]
Aug 12 11:23:08 dist-test-slave-7kzw krb5kdc[20018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533787, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
I20260812 11:23:08.031566 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.031960 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:08.035000 20451 catalog_manager.cc:1347] Generated new cluster ID: 830a229741024b0fae9d2b0adc9a9a0e
I20260812 11:23:08.035112 20451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:08.035713 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.952777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:43841 (local address 127.0.0.1:49840)
0812 11:23:07.953207 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:07.953232 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:07.953341 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:07.995643 (+ 42302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:07.995665 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:07.996266 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:07.996526 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:07.996540 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.003526 (+ 6986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.003532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:08.005086 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:08.005103 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.018243 (+ 13140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.018254 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:08.018598 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.020041 (+ 1443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:08.020067 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:08.023866 (+ 3799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:08.032660 (+ 8794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:08.032668 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:08.032673 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:08.033222 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:08.033618 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:08.033623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:08.033627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:08.033858 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:08.034540 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:08.034576 (+ 36us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:08.034769 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 11:23:08.034948 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 11:23:08.035338 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284}
I20260812 11:23:08.036437 20434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.036731 20434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 11:23:08.057420 20480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:08.057569 20480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:08.068207 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:07.953576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.15.164.252:43841)
0812 11:23:07.995145 (+ 41569us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:07.995151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:07.995177 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:23:07.995230 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:07.995235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:07.995326 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:07.996751 (+ 1425us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:07.997131 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:07.998707 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.005929 (+ 7222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.017886 (+ 11957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.019259 (+ 1373us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.024373 (+ 5114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:08.024422 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:08.024432 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:08.024517 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:08.032493 (+ 7976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.033348 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.033353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.033357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.033505 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:08.033970 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:08.033975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:08.033978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:08.034352 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:08.034524 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.066818 (+ 32294us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.067383 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6976,"server-negotiator.queue_time_us":41377,"thread_start_us":41818,"threads_started":1}
I20260812 11:23:08.074815 20289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: Bootstrap starting.
I20260812 11:23:08.078990 20289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:08.080324 20289 log.cc:824] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:08.085786 20289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: No bootstrap required, opened a new log
I20260812 11:23:08.045318 20300 master_runner.cc:186] Error getting master registration for 127.15.164.253:40933: OK, instance_id { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" instance_seqno: 1786533787207712 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:08.087248 20300 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:23:08.103943 20289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:08.104760 20289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962a2b79a1a4485f8e2e6d2b206b722d, State: Initialized, Role: FOLLOWER
I20260812 11:23:08.105719 20289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } }
I20260812 11:23:08.116477 20485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.119076 20246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a909915ae594cd2b166a898e743009c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "962a2b79a1a4485f8e2e6d2b206b722d"
I20260812 11:23:08.119400 20289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:08.119465 20242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:08.128226 20485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:08.131369 20242 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [term 1 FOLLOWER]: Refusing update from remote peer 3a909915ae594cd2b166a898e743009c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:08.135027 20246 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a909915ae594cd2b166a898e743009c in term 1.
I20260812 11:23:08.137640 20414 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [LEADER]: Connected to new peer: Peer: permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:08.178623 20485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a909915ae594cd2b166a898e743009c. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.178983 20485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:08.180286 20503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.180846 20503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:08.183346 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a909915ae594cd2b166a898e743009c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a909915ae594cd2b166a898e743009c" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 44877 } } peers { permanent_uuid: "962a2b79a1a4485f8e2e6d2b206b722d" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 40933 } } peers { permanent_uuid: "6e152f392683429d9820d1d383d89a75" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 43841 } } }
I20260812 11:23:08.183590 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:08.189500 20451 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:08.191598 20451 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:08.222931 20451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a909915ae594cd2b166a898e743009c: Generated new TSK 0
I20260812 11:23:08.224050 20451 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:08.253777 20511 catalog_manager.cc:1259] Loaded cluster ID: 830a229741024b0fae9d2b0adc9a9a0e
I20260812 11:23:08.253999 20511 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: loading cluster ID for follower catalog manager: success
I20260812 11:23:08.258138 20511 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: acquiring CA information for follower catalog manager: success
I20260812 11:23:08.261034 20511 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 962a2b79a1a4485f8e2e6d2b206b722d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:23:08.364641 20297 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.348159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.15.164.253:40933)
0812 11:23:08.348371 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.348379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.360387 (+ 12008us) server_negotiation.cc:407] Connection header received
0812 11:23:08.362904 (+ 2517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.362911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.363009 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.363106 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.364385 (+ 1279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55420: BlockingRecv error: recv got EOF from 127.0.0.1:55420 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 11:23:08.369196 20411 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.356299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37902 (local address 127.15.164.254:44877)
0812 11:23:08.356503 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.356510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.365890 (+ 9380us) server_negotiation.cc:407] Connection header received
0812 11:23:08.366921 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.366927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.367013 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.367105 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.368885 (+ 1780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37902: BlockingRecv error: recv got EOF from 127.0.0.1:37902 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 11:23:08.370743 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.361011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49844 (local address 127.15.164.252:43841)
0812 11:23:08.361264 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.361270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.366587 (+ 5317us) server_negotiation.cc:407] Connection header received
0812 11:23:08.366740 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.366749 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.366844 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.366973 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.370505 (+ 3532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49844: BlockingRecv error: recv got EOF from 127.0.0.1:49844 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:23:08.420487 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.401368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55436 (local address 127.15.164.253:40933)
0812 11:23:08.401552 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.401559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.412185 (+ 10626us) server_negotiation.cc:407] Connection header received
0812 11:23:08.412772 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.412779 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.413000 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.413149 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.413891 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.415138 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.417358 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.418059 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.418161 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.418971 (+ 810us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.419665 (+ 694us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.419785 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.420045 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.420145 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260812 11:23:08.467655 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.453898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.15.164.252:43841)
0812 11:23:08.454095 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.454102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.465318 (+ 11216us) server_negotiation.cc:407] Connection header received
0812 11:23:08.465881 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.465888 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.466030 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.466132 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.467350 (+ 1218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49860: BlockingRecv error: recv got EOF from 127.0.0.1:49860 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:23:08.522554 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.504118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.15.164.253:40933)
0812 11:23:08.504371 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.504378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.515263 (+ 10885us) server_negotiation.cc:407] Connection header received
0812 11:23:08.515906 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.515916 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.516022 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.516118 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.516841 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.518077 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.520191 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.520901 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.520997 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.521645 (+ 648us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.521816 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.521877 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.522114 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.522204 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 11:23:08.569794 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.556367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49876 (local address 127.15.164.252:43841)
0812 11:23:08.556602 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.556609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.567375 (+ 10766us) server_negotiation.cc:407] Connection header received
0812 11:23:08.568032 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.568038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.568173 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.568264 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.569521 (+ 1257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49876: BlockingRecv error: recv got EOF from 127.0.0.1:49876 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 11:23:08.622116 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.607731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.15.164.253:40933)
0812 11:23:08.607952 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.607959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.615282 (+ 7323us) server_negotiation.cc:407] Connection header received
0812 11:23:08.615521 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.615529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.615644 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.615760 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.616381 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.617630 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.619757 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.620482 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.620624 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.621157 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.621319 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.621417 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.621620 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.621734 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260812 11:23:08.634684 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.632390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.15.164.252:43841)
0812 11:23:08.632572 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.632578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.632982 (+ 404us) server_negotiation.cc:407] Connection header received
0812 11:23:08.633201 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.633207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.633336 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.633460 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.634418 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49884: BlockingRecv error: recv got EOF from 127.0.0.1:49884 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:23:08.650000 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.642628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.15.164.253:40933)
0812 11:23:08.642880 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.642887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.642954 (+ 67us) server_negotiation.cc:407] Connection header received
0812 11:23:08.643288 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.643294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.643414 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.643544 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.644031 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.645331 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.647451 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.648194 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.648347 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.648919 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.649086 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.649201 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.649400 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.649499 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
W20260812 11:23:08.668953 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.666121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49886 (local address 127.15.164.252:43841)
0812 11:23:08.666447 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.666455 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.667128 (+ 673us) server_negotiation.cc:407] Connection header received
0812 11:23:08.667363 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.667369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.667485 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.667617 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.668641 (+ 1024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49886: BlockingRecv error: recv got EOF from 127.0.0.1:49886 (error 108)
Metrics: {"server-negotiator.queue_time_us":185}
I20260812 11:23:08.716197 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.708249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55466 (local address 127.15.164.253:40933)
0812 11:23:08.708485 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.708493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.709237 (+ 744us) server_negotiation.cc:407] Connection header received
0812 11:23:08.709448 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.709455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.709565 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.709691 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.710427 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.711628 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.713632 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.714366 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.714589 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.715134 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.715297 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.715372 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.715697 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.715795 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 11:23:08.726090 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.724027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.15.164.252:43841)
0812 11:23:08.724238 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.724243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.724264 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:23:08.724519 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.724525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.724637 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.724727 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.725804 (+ 1077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49902: BlockingRecv error: recv got EOF from 127.0.0.1:49902 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:23:08.754279 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.746710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.15.164.253:40933)
0812 11:23:08.746913 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.746921 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.747468 (+ 547us) server_negotiation.cc:407] Connection header received
0812 11:23:08.747676 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.747682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.747787 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.747885 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.748428 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.749672 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.751811 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.752796 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.752926 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.753498 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.753661 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.753742 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.753913 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.753983 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 11:23:08.769032 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.760792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.15.164.252:43841)
0812 11:23:08.761051 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.761061 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.767365 (+ 6304us) server_negotiation.cc:407] Connection header received
0812 11:23:08.767604 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.767610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.767726 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.767833 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.768766 (+ 933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49904: BlockingRecv error: recv got EOF from 127.0.0.1:49904 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:23:08.811007 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.805299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55484 (local address 127.15.164.253:40933)
0812 11:23:08.805567 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.805580 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.806005 (+ 425us) server_negotiation.cc:407] Connection header received
0812 11:23:08.806187 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.806192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.806272 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.806370 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.806979 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.807770 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.809157 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.809629 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.809737 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.810189 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.810302 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.810375 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.810647 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.810734 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260812 11:23:08.819558 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.817501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.15.164.252:43841)
0812 11:23:08.817760 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.817767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.818114 (+ 347us) server_negotiation.cc:407] Connection header received
0812 11:23:08.818282 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.818287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.818362 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.818449 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.819307 (+ 858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49918: BlockingRecv error: recv got EOF from 127.0.0.1:49918 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:23:08.892590 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:08.887140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55500 (local address 127.15.164.253:40933)
0812 11:23:08.887337 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.887342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.887764 (+ 422us) server_negotiation.cc:407] Connection header received
0812 11:23:08.887939 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.887943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.888017 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.888114 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:08.888612 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.889481 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.890809 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:08.891231 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:08.891334 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:08.891838 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:08.891973 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:08.892076 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:08.892274 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 11:23:08.892351 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 11:23:08.900960 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:08.898875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49934 (local address 127.15.164.252:43841)
0812 11:23:08.899074 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:08.899079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:08.899438 (+ 359us) server_negotiation.cc:407] Connection header received
0812 11:23:08.899600 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:08.899604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:08.899683 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:08.899807 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:08.900755 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49934: BlockingRecv error: recv got EOF from 127.0.0.1:49934 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:23:09.038018 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.032840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.15.164.253:40933)
0812 11:23:09.033097 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.033105 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.033296 (+ 191us) server_negotiation.cc:407] Connection header received
0812 11:23:09.033538 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.033549 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.033622 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.033729 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.034176 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.034928 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.036229 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.036684 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.036828 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.037238 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.037347 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.037446 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.037601 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.037685 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
W20260812 11:23:09.046064 20466 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:09.044295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.15.164.252:43841)
0812 11:23:09.044540 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.044546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.044726 (+ 180us) server_negotiation.cc:407] Connection header received
0812 11:23:09.044870 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.044874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.044946 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.045031 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:09.045791 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49946: BlockingRecv error: recv got EOF from 127.0.0.1:49946 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:23:09.059736 20480 catalog_manager.cc:1259] Loaded cluster ID: 830a229741024b0fae9d2b0adc9a9a0e
I20260812 11:23:09.059826 20480 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: loading cluster ID for follower catalog manager: success
I20260812 11:23:09.062517 20480 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: acquiring CA information for follower catalog manager: success
I20260812 11:23:09.064258 20480 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e152f392683429d9820d1d383d89a75: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:23:09.313736 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.308334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.15.164.253:40933)
0812 11:23:09.308557 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.308564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.308934 (+ 370us) server_negotiation.cc:407] Connection header received
0812 11:23:09.309101 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.309110 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.309195 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.309319 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.309827 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.310691 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.312017 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.312432 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.312524 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.312976 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.313128 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.313219 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.313374 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.313444 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:23:09.325120 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.319812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.15.164.252:43841)
0812 11:23:09.319985 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.319989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.320251 (+ 262us) server_negotiation.cc:407] Connection header received
0812 11:23:09.320392 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.320396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.320553 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.320655 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.321054 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.321738 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.323160 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.323576 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.323670 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.324129 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.324638 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.324753 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.324854 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.324923 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:23:09.339874 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.331536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55520 (local address 127.15.164.253:40933)
0812 11:23:09.331782 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.331791 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.332815 (+ 1024us) server_negotiation.cc:407] Connection header received
0812 11:23:09.332901 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.332908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.333006 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.333092 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.334418 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.335299 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.337500 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.338130 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.338252 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.338983 (+ 731us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.339094 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.339205 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.339440 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.339536 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:23:09.340188 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.333324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.15.164.252:43841)
0812 11:23:09.333550 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.333556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.334012 (+ 456us) server_negotiation.cc:407] Connection header received
0812 11:23:09.334262 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.334267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.334373 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.334497 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.335097 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.335988 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.337983 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.338629 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.338754 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.339389 (+ 635us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.339520 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.339610 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.339823 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.339899 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:23:09.340590 20713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:09.331480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.15.164.254:44877)
0812 11:23:09.333187 (+ 1707us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:09.333194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:09.333225 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:23:09.333352 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:09.333358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:09.333587 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:09.333783 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:09.334666 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.335631 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.337415 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:09.338119 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:09.338262 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:09.338927 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:09.339451 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:09.340051 (+ 600us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:09.340110 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 11:23:09.340199 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1585,"thread_start_us":1488,"threads_started":1}
I20260812 11:23:09.345752 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20036
I20260812 11:23:09.346949 20146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:09.458710 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20036
I20260812 11:23:09.492278 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20168
I20260812 11:23:09.493500 20279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:09.601969 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20168
I20260812 11:23:09.632927 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20300
I20260812 11:23:09.634109 20395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:09.748636 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20300
2026-08-12T11:23:09Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5265 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:23:09 dist-test-slave-7kzw krb5kdc[20730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:23:09 dist-test-slave-7kzw krb5kdc[20730](info): set up 2 sockets
Aug 12 11:23:09 dist-test-slave-7kzw krb5kdc[20730](info): commencing operation
krb5kdc: starting...
W20260812 11:23:11.135656 16019 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/test-user.keytab.
Aug 12 11:23:11 dist-test-slave-7kzw krb5kdc[20730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:23:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:23:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
Entry for principal kudu/127.15.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab.
I20260812 11:23:11.479089 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:46429
--webserver_interface=127.15.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:23:11.841023 20745 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:11.841454 20745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:11.841598 20745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:11.841760 20745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:11.849097 20745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:11.849247 20745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:11.849354 20745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:11.849459 20745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:11.849552 20745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:11.859696 20745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.254.keytab
--principal=kudu/127.15.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.254:46429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:11.861132 20745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:11.862577 20745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:11.875201 20752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:11.875134 20753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:11.875237 20758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:11.876246 20745 server_base.cc:1034] running on GCE node
I20260812 11:23:11.877080 20745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:11.878738 20745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:11.879982 20745 hybrid_clock.cc:648] HybridClock initialized: now 1786533791879904 us; error 68 us; skew 500 ppm
I20260812 11:23:11.880409 20745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:11 dist-test-slave-7kzw krb5kdc[20730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:11.883910 20745 init.cc:377] Logged in from keytab as kudu/127.15.164.254@KRBTEST.COM (short username kudu)
I20260812 11:23:11.885468 20745 webserver.cc:460] Webserver started at http://127.15.164.254:35845/ using document root <none> and password file <none>
I20260812 11:23:11.886246 20745 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:11.886386 20745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:11.886874 20745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:11.891288 20745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data/instance:
uuid: "cee6b79af36e42b38d4c6eb63e58c34a"
format_stamp: "Formatted at 2026-08-12 11:23:11 on dist-test-slave-7kzw"
server_key: "26983a565273b5ba01265a20639a77dc"
server_key_iv: "732a1bf593b1b6f4dbe03117377d1ada"
server_key_version: "encryptionkey@0"
I20260812 11:23:11.892130 20745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance:
uuid: "cee6b79af36e42b38d4c6eb63e58c34a"
format_stamp: "Formatted at 2026-08-12 11:23:11 on dist-test-slave-7kzw"
server_key: "26983a565273b5ba01265a20639a77dc"
server_key_iv: "732a1bf593b1b6f4dbe03117377d1ada"
server_key_version: "encryptionkey@0"
I20260812 11:23:11.897716 20745 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:23:11.901664 20774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:11.903198 20745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:23:11.903398 20745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal
uuid: "cee6b79af36e42b38d4c6eb63e58c34a"
format_stamp: "Formatted at 2026-08-12 11:23:11 on dist-test-slave-7kzw"
server_key: "26983a565273b5ba01265a20639a77dc"
server_key_iv: "732a1bf593b1b6f4dbe03117377d1ada"
server_key_version: "encryptionkey@0"
I20260812 11:23:11.903633 20745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:11.934182 20745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:11.938817 20745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:11.939119 20745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:11.959194 20745 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.254:46429
I20260812 11:23:11.959232 20860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.254:46429 every 8 connection(s)
I20260812 11:23:11.960652 20745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/data/info.pb
I20260812 11:23:11.962941 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20745
I20260812 11:23:11.963151 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-0/wal/instance
I20260812 11:23:11.963778 16019 external_mini_cluster.cc:1428] Setting key 0cb2107c78599f902b0c700a49b05df6
I20260812 11:23:11.965405 20863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:11.975838 20863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:11 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.164.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.253@KRBTEST.COM" created.
I20260812 11:23:12.000200 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:11.981515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.15.164.254:46429)
0812 11:23:11.982327 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:11.982335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:11.982386 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:23:11.983651 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:11.983657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:11.983886 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:11.984104 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:11.985452 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:11.986737 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:11.988160 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:11.988705 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:11.988913 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:11.992445 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:11.992454 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:11.992467 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:11.992499 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:11.995463 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:11.996263 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:11.996276 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:11.996278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:11.996439 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:11.996901 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:11.996913 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:11.996915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:11.997403 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:11.997622 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:11.998202 (+ 580us) server_negotiation.cc:299] Negotiation successful
0812 11:23:11.998660 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":580,"thread_start_us":394,"threads_started":1}
I20260812 11:23:12.000222 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:11.980179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46429 (local address 127.0.0.1:37116)
0812 11:23:11.981037 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:11.981077 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:11.983266 (+ 2189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:11.984118 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:11.984124 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:11.984870 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:11.985216 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:11.985233 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:11.986909 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:11.986914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:11.987996 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:11.988009 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:11.988952 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:11.988958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:11.989164 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:11.989863 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:11.989887 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:11.992199 (+ 2312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:11.995602 (+ 3403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:11.995616 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:11.995628 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:11.996110 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:11.996555 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:11.996561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:11.996565 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:11.996786 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:11.997585 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:11.997593 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:11.997813 (+ 220us) client_negotiation.cc:769] Sending connection context
0812 11:23:11.998071 (+ 258us) client_negotiation.cc:240] Negotiation successful
0812 11:23:11.998840 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":208,"thread_start_us":366,"threads_started":1}
I20260812 11:23:12.003729 20863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:12.004963 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.004453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51540)
0812 11:23:12.004660 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.004800 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 11:23:12.005282 20780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
I20260812 11:23:12.006969 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.006551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51552)
0812 11:23:12.006716 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.006806 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:23:12.007249 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:43661: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
Entry for principal kudu/127.15.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab.
I20260812 11:23:12.038606 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:43661
--webserver_interface=127.15.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:12.056679 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } attempt: 1
I20260812 11:23:12.057997 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.057482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51554)
0812 11:23:12.057717 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.057857 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 11:23:12.059209 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.058823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51558)
0812 11:23:12.058985 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.059069 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 11:23:12.059434 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:43661: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
I20260812 11:23:12.127787 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } attempt: 2
I20260812 11:23:12.129086 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.128568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51568)
0812 11:23:12.128848 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.128941 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:23:12.130187 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.129821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51584)
0812 11:23:12.129975 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.130062 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:23:12.130396 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:43661: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
I20260812 11:23:12.221736 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } attempt: 3
I20260812 11:23:12.222992 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.222525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51596)
0812 11:23:12.222746 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.222855 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:23:12.224030 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.223667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51612)
0812 11:23:12.223819 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.223894 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:23:12.224206 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:43661: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
I20260812 11:23:12.367460 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } attempt: 4
I20260812 11:23:12.368911 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.368295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51626)
0812 11:23:12.368662 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.368768 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196}
I20260812 11:23:12.370004 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.369620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51630)
0812 11:23:12.369782 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.369880 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:23:12.370193 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.253:43661: Network error: Client connection negotiation failed: client connection to 127.15.164.253:43661: connect: Connection refused (error 111)
W20260812 11:23:12.396715 20873 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:12.397164 20873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:12.397292 20873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:12.397454 20873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:12.404738 20873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:12.404868 20873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:12.404973 20873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:12.405077 20873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:12.405169 20873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:12.415467 20873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.253.keytab
--principal=kudu/127.15.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.253:43661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:12.416878 20873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:12.418294 20873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:12.431167 20884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:12.431305 20879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:12.431326 20887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:12.432377 20873 server_base.cc:1034] running on GCE node
I20260812 11:23:12.433243 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:12.434746 20873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:12.435979 20873 hybrid_clock.cc:648] HybridClock initialized: now 1786533792435918 us; error 28 us; skew 500 ppm
I20260812 11:23:12.436299 20873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:12 dist-test-slave-7kzw krb5kdc[20730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:12.444248 20873 init.cc:377] Logged in from keytab as kudu/127.15.164.253@KRBTEST.COM (short username kudu)
I20260812 11:23:12.445863 20873 webserver.cc:460] Webserver started at http://127.15.164.253:46765/ using document root <none> and password file <none>
I20260812 11:23:12.446694 20873 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:12.446839 20873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:12.447180 20873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:12.450232 20873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data/instance:
uuid: "5d4097b0e9264c848e2aa2d98045f064"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "4c0c43ef3c09bf1dfc56e505f3e2f452"
server_key_iv: "61e521a7713ed393c38fe263eb62fb6d"
server_key_version: "encryptionkey@0"
I20260812 11:23:12.451116 20873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal/instance:
uuid: "5d4097b0e9264c848e2aa2d98045f064"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "4c0c43ef3c09bf1dfc56e505f3e2f452"
server_key_iv: "61e521a7713ed393c38fe263eb62fb6d"
server_key_version: "encryptionkey@0"
I20260812 11:23:12.456318 20873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:23:12.459756 20897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:12.461059 20873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:23:12.461247 20873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal
uuid: "5d4097b0e9264c848e2aa2d98045f064"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "4c0c43ef3c09bf1dfc56e505f3e2f452"
server_key_iv: "61e521a7713ed393c38fe263eb62fb6d"
server_key_version: "encryptionkey@0"
I20260812 11:23:12.461483 20873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:12.480604 20873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:12.485220 20873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:12.485517 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:12.505323 20873 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.253:43661
I20260812 11:23:12.505342 20975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.253:43661 every 8 connection(s)
I20260812 11:23:12.506806 20873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/data/info.pb
I20260812 11:23:12.511111 20978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:12.511937 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20873
I20260812 11:23:12.512166 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-1/wal/instance
I20260812 11:23:12.512676 16019 external_mini_cluster.cc:1428] Setting key 662669c516239537d67ccf2fd9c8de78
I20260812 11:23:12.517890 20978 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:12 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:12.540845 20980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.520600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37130 (local address 127.15.164.254:46429)
0812 11:23:12.521191 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:12.521196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:12.522133 (+ 937us) server_negotiation.cc:407] Connection header received
0812 11:23:12.524058 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:12.524064 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:12.524153 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:12.524278 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:12.525898 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.526721 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.529203 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.529601 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.529731 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.534359 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:12.534365 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:12.534368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:12.534413 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:12.537301 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.538366 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.538370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.538372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.538545 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.539030 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.539033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.539035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.539312 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:12.539431 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:12.540395 (+ 964us) server_negotiation.cc:299] Negotiation successful
0812 11:23:12.540564 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":350,"threads_started":1}
I20260812 11:23:12.542429 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.521167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46429 (local address 127.0.0.1:37130)
0812 11:23:12.521942 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.521985 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:12.523774 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:12.524524 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:12.524533 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:12.525050 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:12.525658 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.525686 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.526900 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.526908 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.529029 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.529048 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.529864 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.529875 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.530222 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.531030 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:12.531078 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:12.534108 (+ 3030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:12.537463 (+ 3355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.537475 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.537494 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.538235 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.538662 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.538670 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.538675 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.538915 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.539472 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:12.539483 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:12.539995 (+ 512us) client_negotiation.cc:769] Sending connection context
0812 11:23:12.540325 (+ 330us) client_negotiation.cc:240] Negotiation successful
0812 11:23:12.540897 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":354,"threads_started":1}
I20260812 11:23:12.544482 20978 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.164.252@KRBTEST.COM" created.
Aug 12 11:23:12 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:12.561488 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.545229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51632)
0812 11:23:12.545433 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.545456 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:12.545542 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:12.546640 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:12.546644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:12.547129 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:12.547302 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.547312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.548829 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.548836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.549933 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.549946 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.551129 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.551135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.551367 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.552018 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:12.552038 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:12.554387 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:12.558905 (+ 4518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.558914 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.558919 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.559332 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.559779 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.559782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.559785 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.559937 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.560713 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:12.560717 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:12.560835 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 11:23:12.560953 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:23:12.561178 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":35}
I20260812 11:23:12.562177 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.545527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51632 (local address 127.15.164.253:43661)
0812 11:23:12.546197 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:12.546203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:12.546227 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:23:12.546283 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:12.546288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:12.546448 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:12.546650 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:12.547484 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.548686 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.550070 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.550963 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.551112 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.554657 (+ 3545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:12.554675 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:12.554695 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:12.554737 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:12.558704 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.559476 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.559488 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.559494 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.559647 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.560049 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.560056 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.560062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.560565 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:12.560770 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:12.561153 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 11:23:12.561459 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":526,"thread_start_us":392,"threads_started":1}
I20260812 11:23:12.565004 20978 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:12.566250 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.565679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47836)
0812 11:23:12.565895 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.566059 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 11:23:12.566602 20898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.568364 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.567911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47844)
0812 11:23:12.568120 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.568223 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:23:12.568576 20978 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
Entry for principal kudu/127.15.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab.
I20260812 11:23:12.590023 16019 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskghXBKM/build/asan/bin/kudu
/tmp/dist-test-taskghXBKM/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:34675
--webserver_interface=127.15.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.164.212:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:23:12.617976 20978 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 1
I20260812 11:23:12.619498 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.618773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47848)
0812 11:23:12.619079 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.619252 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 11:23:12.620977 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.620429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47864)
0812 11:23:12.620655 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.620785 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:23:12.621302 20978 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.669445 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } attempt: 5
Aug 12 11:23:12 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:12.684991 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.670414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51638 (local address 127.15.164.253:43661)
0812 11:23:12.670606 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:12.670611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:12.670638 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:23:12.670892 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:12.670897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:12.670974 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:12.671073 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:12.672254 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.673077 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.674814 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.675251 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.675360 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.679260 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:12.679266 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:12.679270 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:12.679306 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:12.682236 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.683019 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.683026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.683035 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.683166 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:12.683573 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:12.683577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:12.683579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:12.683866 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:12.684025 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:12.684431 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:23:12.684651 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:23:12.684993 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.670246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51638)
0812 11:23:12.670517 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.670542 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:12.670691 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:12.671156 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:12.671163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:12.671773 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:12.672071 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.672087 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.673232 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.673238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.674622 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:12.674638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:12.675425 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:12.675433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:12.675656 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:12.676361 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:12.676385 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:12.679025 (+ 2640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:12.682381 (+ 3356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.682387 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.682391 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.682882 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.683287 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:12.683292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:12.683296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:12.683443 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:12.683992 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:12.683997 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:12.684153 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 11:23:12.684301 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:23:12.684628 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:23:12.686131 20863 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:12.687366 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.686887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47866)
0812 11:23:12.687114 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.687214 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:23:12.688522 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.688167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47874)
0812 11:23:12.688314 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.688406 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 11:23:12.688843 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.689561 20978 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 2
I20260812 11:23:12.690541 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.690071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47888)
0812 11:23:12.690252 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.690348 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 11:23:12.691670 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.691225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47892)
0812 11:23:12.691407 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.691511 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:23:12.691938 20978 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.740146 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 1
I20260812 11:23:12.741496 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.740942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47896)
0812 11:23:12.741199 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.741301 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260812 11:23:12.742717 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.742260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47912)
0812 11:23:12.742442 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.742590 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 11:23:12.742950 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.783200 20978 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 3
I20260812 11:23:12.784766 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.783950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47918)
0812 11:23:12.784256 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.784408 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 11:23:12.786178 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.785624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47928)
0812 11:23:12.785913 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.786017 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
W20260812 11:23:12.786486 20978 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.811173 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 2
I20260812 11:23:12.812422 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.811894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47940)
0812 11:23:12.812149 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.812245 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 11:23:12.813484 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.813144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47948)
0812 11:23:12.813295 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.813382 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:23:12.813717 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.919999 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 3
I20260812 11:23:12.921273 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.920746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47956)
0812 11:23:12.920983 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.921096 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:23:12.922673 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.922065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47964)
0812 11:23:12.922375 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.922512 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260812 11:23:12.922962 20863 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
I20260812 11:23:12.929751 20978 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 4
I20260812 11:23:12.931026 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.930405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47972)
0812 11:23:12.930680 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.930797 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 11:23:12.932163 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:12.931723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47976)
0812 11:23:12.931900 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:12.932009 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:23:12.932416 20978 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.164.252:34675: Network error: Client connection negotiation failed: client connection to 127.15.164.252:34675: connect: Connection refused (error 111)
W20260812 11:23:12.960124 20990 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:23:12.960484 20990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:23:12.960609 20990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:23:12.960744 20990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:23:12.968573 20990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:23:12.968672 20990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:23:12.968775 20990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:23:12.968873 20990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:23:12.968986 20990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:23:12.979601 20990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.164.212:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.164.254:46429,127.15.164.253:43661,127.15.164.252:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/krb5kdc/kudu_127.15.164.252.keytab
--principal=kudu/127.15.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.164.252:34675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:23:12.981040 20990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:23:12.982445 20990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:23:12.994638 20996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:12.994735 21001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:23:12.994704 20997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:23:12.995743 20990 server_base.cc:1034] running on GCE node
I20260812 11:23:12.996496 20990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:23:12.997879 20990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:23:12.999101 20990 hybrid_clock.cc:648] HybridClock initialized: now 1786533792999026 us; error 45 us; skew 500 ppm
I20260812 11:23:12.999464 20990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:23:12 dist-test-slave-7kzw krb5kdc[20730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:23:13.002780 20990 init.cc:377] Logged in from keytab as kudu/127.15.164.252@KRBTEST.COM (short username kudu)
I20260812 11:23:13.004244 20990 webserver.cc:460] Webserver started at http://127.15.164.252:41095/ using document root <none> and password file <none>
I20260812 11:23:13.004984 20990 fs_manager.cc:359] Metadata directory not provided
I20260812 11:23:13.005124 20990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:23:13.005465 20990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:23:13.008678 20990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data/instance:
uuid: "f21117d388824527b71c0771ca2ebf0d"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "a5b29b4bf18a90d328e8ba06a23eef5c"
server_key_iv: "696bebf83f2ac51f807f43ea40d0c8bc"
server_key_version: "encryptionkey@0"
I20260812 11:23:13.009514 20990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal/instance:
uuid: "f21117d388824527b71c0771ca2ebf0d"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "a5b29b4bf18a90d328e8ba06a23eef5c"
server_key_iv: "696bebf83f2ac51f807f43ea40d0c8bc"
server_key_version: "encryptionkey@0"
I20260812 11:23:13.014740 20990 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:23:13.018118 21011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:23:13.019564 20990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:23:13.019770 20990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data,/tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal
uuid: "f21117d388824527b71c0771ca2ebf0d"
format_stamp: "Formatted at 2026-08-12 11:23:12 on dist-test-slave-7kzw"
server_key: "a5b29b4bf18a90d328e8ba06a23eef5c"
server_key_iv: "696bebf83f2ac51f807f43ea40d0c8bc"
server_key_version: "encryptionkey@0"
I20260812 11:23:13.019991 20990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:23:13.043354 20990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:23:13.047870 20990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:23:13.048099 20990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:23:13.067035 20990 rpc_server.cc:307] RPC server started. Bound to: 127.15.164.252:34675
I20260812 11:23:13.067056 21093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.164.252:34675 every 8 connection(s)
I20260812 11:23:13.068409 20990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/data/info.pb
I20260812 11:23:13.072410 21096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:23:13.075451 16019 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskghXBKM/build/asan/bin/kudu as pid 20990
I20260812 11:23:13.075637 16019 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskghXBKM/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786533397360424-16019-0/minicluster-data/master-2/wal/instance
I20260812 11:23:13.076122 16019 external_mini_cluster.cc:1428] Setting key 8f98b161dba0baf902c2902c8814c576
I20260812 11:23:13.080755 21096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:13.100214 20863 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 4
I20260812 11:23:13.100847 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.083976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37146 (local address 127.15.164.254:46429)
0812 11:23:13.084503 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.084508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.085168 (+ 660us) server_negotiation.cc:407] Connection header received
0812 11:23:13.085419 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.085423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.085493 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.085704 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.086789 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.087649 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.089089 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.089881 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.090045 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.093766 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.093775 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.093782 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.093844 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.097393 (+ 3549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.098340 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.098347 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.098350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.098620 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.099071 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.099076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.099079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.099367 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.099538 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.100067 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.100307 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":288,"threads_started":1}
I20260812 11:23:13.100965 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.077978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47978 (local address 127.15.164.252:34675)
0812 11:23:13.078887 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.078899 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.078941 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:23:13.080528 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.080551 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.080931 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.081251 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.083324 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.085430 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.087037 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.087635 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.087834 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.092844 (+ 5010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.092854 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.092875 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.092924 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.096060 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.096939 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.096946 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.096952 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.097101 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.097534 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.097539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.097541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.098346 (+ 805us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.098680 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.099161 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.099580 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":412,"threads_started":1}
I20260812 11:23:13.101490 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.084021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.254:46429 (local address 127.0.0.1:37146)
0812 11:23:13.084994 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:13.085044 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:13.085265 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:13.085746 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:13.085750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:13.086315 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:13.086620 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.086631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.087843 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.087848 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.088903 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.088915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.090097 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.090102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.090224 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.090874 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:13.090895 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:13.093547 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:13.097534 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.097544 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.097551 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.098110 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.098801 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.098806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.098810 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.098951 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.099560 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:13.099567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:13.099760 (+ 193us) client_negotiation.cc:769] Sending connection context
0812 11:23:13.099958 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 11:23:13.100286 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":639,"threads_started":1}
I20260812 11:23:13.102994 21096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.254@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.254@KRBTEST.COM
I20260812 11:23:13.117513 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.100853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:47992)
0812 11:23:13.101055 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:13.101077 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:13.101185 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:13.102102 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:13.102109 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:13.102641 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:13.102864 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.102878 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.104141 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.104146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.105668 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.105691 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.106583 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.106589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.106817 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.107583 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:13.107621 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:13.110399 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:13.114525 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.114530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.114536 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.115069 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.115498 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.115502 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.115506 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.115701 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.116419 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:13.116427 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:13.116590 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 11:23:13.116735 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:23:13.117039 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:23:13.118353 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.103679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.253:43661 (local address 127.0.0.1:51644)
0812 11:23:13.104357 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:13.104374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:13.104516 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:13.104875 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:13.104880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:13.105292 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:13.105468 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.105481 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.106787 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.106794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.107916 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.107933 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.108912 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.108921 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.109130 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.109726 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:13.109748 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:13.112068 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:13.115767 (+ 3699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.115774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.115777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.116190 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.116588 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.116593 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.116598 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.116739 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.117262 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:13.117266 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:13.117412 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 11:23:13.117711 (+ 299us) client_negotiation.cc:240] Negotiation successful
0812 11:23:13.117987 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576}
I20260812 11:23:13.118518 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.104036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.15.164.253:43661)
0812 11:23:13.104229 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.104235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.104432 (+ 197us) server_negotiation.cc:407] Connection header received
0812 11:23:13.104674 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.104678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.104744 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.104817 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.105621 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.106641 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.108077 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.108731 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.108867 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.112272 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.112277 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.112280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.112313 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.115541 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.116322 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.116327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.116330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.116476 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.116852 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.116857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.116861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.117135 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.117303 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.117895 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.118108 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:23:13.118674 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.101612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47992 (local address 127.15.164.252:34675)
0812 11:23:13.101795 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.101801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.101818 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:23:13.101867 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.101871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.101939 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.102037 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.103006 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.103997 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.105807 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.106397 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.106567 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.110625 (+ 4058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.110633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.110641 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.110671 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.114345 (+ 3674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.115193 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.115206 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.115209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.115365 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.115830 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.115835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.115838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.116252 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.117904 (+ 1652us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.118046 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.118267 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:23:13.120268 21096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:23:13.123520 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.105867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.15.164.254:46429)
0812 11:23:13.106030 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.106034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.106047 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:23:13.106082 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.106085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.106146 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.106252 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.107946 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.108890 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.110765 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.111489 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.111632 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.116855 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.116861 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.116865 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.116898 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.120321 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.121229 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.121233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.121235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.121356 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.121764 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.121769 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.121773 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.122073 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.122407 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.122829 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.123061 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:23:13.125151 20863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: Bootstrap starting.
I20260812 11:23:13.129127 20863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: Neither blocks nor log segments found. Creating new log.
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.252@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
I20260812 11:23:13.130451 20863 log.cc:824] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.164.253@KRBTEST.COM
I20260812 11:23:13.137414 20863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: No bootstrap required, opened a new log
I20260812 11:23:13.138717 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.121011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:48006)
0812 11:23:13.121310 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:13.121330 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:13.121423 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:13.123003 (+ 1580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:13.123008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:13.123515 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:13.123718 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.123729 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.125214 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.125220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.126557 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.126572 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.127591 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.127597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.127864 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.128430 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:13.128447 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:13.131186 (+ 2739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:13.135388 (+ 4202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.135396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.135400 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.135909 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.136367 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.136373 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.136378 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.136543 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.137249 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:13.137255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:13.137701 (+ 446us) client_negotiation.cc:769] Sending connection context
0812 11:23:13.137889 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 11:23:13.138233 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260812 11:23:13.138957 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.121073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.15.164.252:34675)
0812 11:23:13.122663 (+ 1590us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.122669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.122687 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:23:13.122730 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.122735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.122798 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.122884 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.123853 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.125062 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.126745 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.127450 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.127573 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.131457 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.131466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.131474 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.131519 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.135245 (+ 3726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.136048 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.136053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.136056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.136229 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.136663 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.136668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.136671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.137093 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.137264 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.138060 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.138410 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":1447}
I20260812 11:23:13.142768 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.125520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51652 (local address 127.15.164.253:43661)
0812 11:23:13.125678 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.125682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.125701 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:23:13.125739 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.125742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.125791 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.125895 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.127441 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.128449 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.130154 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.130727 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.130854 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.135526 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.135532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.135538 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.135576 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.139589 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.140574 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.140579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.140585 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.140780 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.141234 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.141239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.141242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.141576 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.141864 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.142143 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.142378 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:23:13.144388 21096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: Bootstrap starting.
I20260812 11:23:13.147683 20863 raft_consensus.cc:348] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.148016 20863 raft_consensus.cc:729] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee6b79af36e42b38d4c6eb63e58c34a, State: Initialized, Role: FOLLOWER
I20260812 11:23:13.148260 16019 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:23:13.148329 21096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:13.148530 20863 consensus_queue.cc:260] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.149508 21096 log.cc:824] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:13.149537 21107 sys_catalog.cc:455] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.149957 21107 sys_catalog.cc:458] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.150745 20863 sys_catalog.cc:564] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:13.151538 20825 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cee6b79af36e42b38d4c6eb63e58c34a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37152
I20260812 11:23:13.151906 20825 raft_consensus.cc:482] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:23:13.152134 20825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:13.156988 20825 raft_consensus.cc:504] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.158376 21096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: No bootstrap required, opened a new log
I20260812 11:23:13.161026 20825 leader_election.cc:288] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [CANDIDATE]: Term 1 election: Requested vote from peers 5d4097b0e9264c848e2aa2d98045f064 (127.15.164.253:43661), f21117d388824527b71c0771ca2ebf0d (127.15.164.252:34675)
W20260812 11:23:13.167797 21128 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:23:13.167932 21128 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:23:13.170347 21096 raft_consensus.cc:348] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.170799 21096 raft_consensus.cc:729] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21117d388824527b71c0771ca2ebf0d, State: Initialized, Role: FOLLOWER
I20260812 11:23:13.171307 21096 consensus_queue.cc:260] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.167127 20745 master_runner.cc:186] Error getting master registration for 127.15.164.253:43661: OK, instance_id { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" instance_seqno: 1786533792499745 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:13.183312 20745 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:23:13.189366 21133 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.189971 21133 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.191126 21096 sys_catalog.cc:564] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:13.191172 21056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f21117d388824527b71c0771ca2ebf0d"
I20260812 11:23:13.191733 21056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:23:13.192082 20785 tablet.cc:2369] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:23:13.195317 21056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cee6b79af36e42b38d4c6eb63e58c34a in term 1.
I20260812 11:23:13.196035 20775 leader_election.cc:302] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cee6b79af36e42b38d4c6eb63e58c34a, f21117d388824527b71c0771ca2ebf0d; no voters:
I20260812 11:23:13.196538 21107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:23:13.197304 21107 raft_consensus.cc:686] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [term 1 LEADER]: Becoming Leader. State: Replica: cee6b79af36e42b38d4c6eb63e58c34a, State: Running, Role: LEADER
I20260812 11:23:13.197971 21107 consensus_queue.cc:237] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.216636 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.188023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48010 (local address 127.15.164.252:34675)
0812 11:23:13.188207 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.188214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.188923 (+ 709us) server_negotiation.cc:407] Connection header received
0812 11:23:13.194575 (+ 5652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.194586 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.194700 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.194791 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.197600 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.198641 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.200433 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.201134 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.201288 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.206048 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.206057 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.206065 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.206116 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.211582 (+ 5466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.212529 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.212535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.212538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.212698 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.213234 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.213240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.213244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.213907 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.214371 (+ 464us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.215570 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.215987 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:23:13.216449 21149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cee6b79af36e42b38d4c6eb63e58c34a. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.217038 21149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:13.225273 21158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:23:13.231619 20978 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } attempt: 5
I20260812 11:23:13.235424 21158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 11:23:13 dist-test-slave-7kzw krb5kdc[20730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533792, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.164.253@KRBTEST.COM for kudu/127.15.164.252@KRBTEST.COM
I20260812 11:23:13.250519 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.187866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37154 (local address 127.15.164.254:46429)
0812 11:23:13.188231 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.188240 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.210520 (+ 22280us) server_negotiation.cc:407] Connection header received
0812 11:23:13.217812 (+ 7292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.217821 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.217934 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.218026 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.220735 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.221904 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.228986 (+ 7082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.229719 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.229852 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.236261 (+ 6409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.236269 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.236274 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.236343 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.240971 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.242523 (+ 1552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.242530 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.242533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.242811 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.246954 (+ 4143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.246962 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.246966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.247729 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.248320 (+ 591us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.249341 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.249775 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237}
I20260812 11:23:13.256239 21056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [term 1 FOLLOWER]: Refusing update from remote peer cee6b79af36e42b38d4c6eb63e58c34a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:13.256556 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.232187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.164.252:34675 (local address 127.0.0.1:48020)
0812 11:23:13.232565 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0812 11:23:13.232585 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:23:13.232690 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:23:13.233460 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:23:13.233467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:23:13.234009 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:23:13.234239 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.234252 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.235851 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.235857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.237259 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:23:13.237276 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.242848 (+ 5572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.242855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:23:13.243119 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.243739 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:23:13.243765 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:23:13.248563 (+ 4798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:23:13.253005 (+ 4442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.253013 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.253020 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.253703 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.254190 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:23:13.254197 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:23:13.254203 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:23:13.254432 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:23:13.255242 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:23:13.255250 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:23:13.255485 (+ 235us) client_negotiation.cc:769] Sending connection context
0812 11:23:13.255669 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 11:23:13.256015 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246}
I20260812 11:23:13.258131 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.232928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48020 (local address 127.15.164.252:34675)
0812 11:23:13.233107 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.233113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.233133 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:23:13.233191 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.233196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.233273 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.234404 (+ 1131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.234590 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.235652 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.237471 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.242668 (+ 5197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.242837 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.248810 (+ 5973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.248815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.248820 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.248859 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.252805 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.253881 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.253889 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.253895 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.254055 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.254641 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.254656 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.254659 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.255056 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.257061 (+ 2005us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.257253 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.257593 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:23:13.258133 21149 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:13.263681 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.203453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51666 (local address 127.15.164.253:43661)
0812 11:23:13.203630 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.203636 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.214719 (+ 11083us) server_negotiation.cc:407] Connection header received
0812 11:23:13.221018 (+ 6299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.221027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.221146 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.221236 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.229083 (+ 7847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.230562 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.237464 (+ 6902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.238139 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.238273 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.243682 (+ 5409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:23:13.243692 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:23:13.243699 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:23:13.243750 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:23:13.248138 (+ 4388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.260156 (+ 12018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.260165 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.260171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.260462 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:23:13.261095 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:23:13.261103 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:23:13.261109 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:23:13.261629 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:23:13.261957 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.262787 (+ 830us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.263128 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62,"spinlock_wait_cycles":32000}
I20260812 11:23:13.270689 20978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: Bootstrap starting.
I20260812 11:23:13.277074 20978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: Neither blocks nor log segments found. Creating new log.
I20260812 11:23:13.278556 20978 log.cc:824] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: Log is configured to *not* fsync() on all Append() calls
I20260812 11:23:13.292109 21133 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cee6b79af36e42b38d4c6eb63e58c34a. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.292454 21133 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.294514 21161 mvcc.cc:205] Tried to move back new op lower bound from 7317642417150316544 to 7317642416944631808. Current Snapshot: MvccSnapshot[applied={T|T < 7317642417150316544}]
I20260812 11:23:13.296448 20978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: No bootstrap required, opened a new log
I20260812 11:23:13.315165 21169 mvcc.cc:205] Tried to move back new op lower bound from 7317642417150316544 to 7317642416944631808. Current Snapshot: MvccSnapshot[applied={T|T < 7317642417150316544}]
I20260812 11:23:13.323518 21107 sys_catalog.cc:455] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.323895 21107 sys_catalog.cc:458] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:13.325242 21158 catalog_manager.cc:1347] Generated new cluster ID: b1fe0eb7fd094321b3caa971fd819bb8
I20260812 11:23:13.325362 21158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:23:13.325987 21133 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.326259 21133 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.328303 20978 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.330823 20978 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4097b0e9264c848e2aa2d98045f064, State: Initialized, Role: FOLLOWER
I20260812 11:23:13.331602 20978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } }
I20260812 11:23:13.333133 21174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.333792 21174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.335506 20941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5d4097b0e9264c848e2aa2d98045f064"
I20260812 11:23:13.340106 20978 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:23:13.341693 21158 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:23:13.342358 20940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:23:13.343523 21158 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:23:13.347321 20940 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [term 1 FOLLOWER]: Refusing update from remote peer cee6b79af36e42b38d4c6eb63e58c34a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:23:13.348421 21107 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:23:13.352295 20941 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cee6b79af36e42b38d4c6eb63e58c34a in term 1.
I20260812 11:23:13.361141 21158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a: Generated new TSK 0
I20260812 11:23:13.362322 21158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:23:13.395426 21187 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:23:13.408170 21174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cee6b79af36e42b38d4c6eb63e58c34a. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.408143 21185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.408581 21174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.408624 21185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:23:13.410193 21149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cee6b79af36e42b38d4c6eb63e58c34a" member_type: VOTER last_known_addr { host: "127.15.164.254" port: 46429 } } peers { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" member_type: VOTER last_known_addr { host: "127.15.164.253" port: 43661 } } peers { permanent_uuid: "f21117d388824527b71c0771ca2ebf0d" member_type: VOTER last_known_addr { host: "127.15.164.252" port: 34675 } } }
I20260812 11:23:13.410594 21149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cee6b79af36e42b38d4c6eb63e58c34a [sys.catalog]: This master's current role is: LEADER
I20260812 11:23:13.403298 20990 master_runner.cc:186] Error getting master registration for 127.15.164.253:43661: OK, instance_id { permanent_uuid: "5d4097b0e9264c848e2aa2d98045f064" instance_seqno: 1786533792499745 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:23:13.414268 20990 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:23:13.436990 21210 catalog_manager.cc:1259] Loaded cluster ID: b1fe0eb7fd094321b3caa971fd819bb8
I20260812 11:23:13.437122 21210 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: loading cluster ID for follower catalog manager: success
I20260812 11:23:13.441067 21210 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: acquiring CA information for follower catalog manager: success
I20260812 11:23:13.443665 21210 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d4097b0e9264c848e2aa2d98045f064: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:23:13.472048 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.458942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.15.164.252:34675)
0812 11:23:13.459150 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.459158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.469526 (+ 10368us) server_negotiation.cc:407] Connection header received
0812 11:23:13.470052 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.470059 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.470152 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.470244 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.471770 (+ 1526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50978: BlockingRecv error: recv got EOF from 127.0.0.1:50978 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 11:23:13.474690 21102 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.458567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40330 (local address 127.15.164.254:46429)
0812 11:23:13.458882 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.458889 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.473061 (+ 14172us) server_negotiation.cc:407] Connection header received
0812 11:23:13.473320 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.473326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.473408 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.473478 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.474404 (+ 926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40330: BlockingRecv error: recv got EOF from 127.0.0.1:40330 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
W20260812 11:23:13.481119 20985 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.479386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42478 (local address 127.15.164.253:43661)
0812 11:23:13.479641 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.479647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.479667 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:23:13.479728 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.479734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.479821 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.479934 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.480893 (+ 959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42478: BlockingRecv error: recv got EOF from 127.0.0.1:42478 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:23:13.491719 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.485034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.15.164.253:43661)
0812 11:23:13.485236 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.485245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.485743 (+ 498us) server_negotiation.cc:407] Connection header received
0812 11:23:13.485980 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.485984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.486133 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.486311 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.486782 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.487614 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.489321 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.489859 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.489935 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.490566 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.491068 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.491230 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.491321 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.491418 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:23:13.500655 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.498127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50984 (local address 127.15.164.252:34675)
0812 11:23:13.498347 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.498356 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.499014 (+ 658us) server_negotiation.cc:407] Connection header received
0812 11:23:13.499397 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.499401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.499524 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.499642 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.500412 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50984: BlockingRecv error: recv got EOF from 127.0.0.1:50984 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:23:13.519160 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.505335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42498 (local address 127.15.164.253:43661)
0812 11:23:13.505550 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.505555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.512347 (+ 6792us) server_negotiation.cc:407] Connection header received
0812 11:23:13.512811 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.512816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.512920 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.512987 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.513633 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.514817 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.516831 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.517535 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.517638 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.518299 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.518454 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.518535 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.518765 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.518850 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 11:23:13.556583 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.552924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.15.164.252:34675)
0812 11:23:13.553183 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.553193 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.555067 (+ 1874us) server_negotiation.cc:407] Connection header received
0812 11:23:13.555307 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.555313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.555401 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.555516 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.556352 (+ 836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50996: BlockingRecv error: recv got EOF from 127.0.0.1:50996 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:23:13.567618 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.561552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42504 (local address 127.15.164.253:43661)
0812 11:23:13.561812 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.561821 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.562335 (+ 514us) server_negotiation.cc:407] Connection header received
0812 11:23:13.562581 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.562587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.562668 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.562772 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.563214 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.564133 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.565636 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.566174 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.566324 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.566795 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.566936 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.567038 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.567167 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.567257 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 11:23:13.576776 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.573886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51012 (local address 127.15.164.252:34675)
0812 11:23:13.574190 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.574211 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.575097 (+ 886us) server_negotiation.cc:407] Connection header received
0812 11:23:13.575490 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.575496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.575582 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.575701 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.576557 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51012: BlockingRecv error: recv got EOF from 127.0.0.1:51012 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
I20260812 11:23:13.589983 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.584345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.15.164.253:43661)
0812 11:23:13.584660 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.584669 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.585158 (+ 489us) server_negotiation.cc:407] Connection header received
0812 11:23:13.585383 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.585389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.585513 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.585620 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.586046 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.586875 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.588202 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.588700 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.588840 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.589225 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.589330 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.589436 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.589586 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.589667 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
W20260812 11:23:13.598451 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.596168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51028 (local address 127.15.164.252:34675)
0812 11:23:13.596501 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.596510 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.597046 (+ 536us) server_negotiation.cc:407] Connection header received
0812 11:23:13.597253 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.597259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.597345 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.597454 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.598225 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51028: BlockingRecv error: recv got EOF from 127.0.0.1:51028 (error 108)
Metrics: {"server-negotiator.queue_time_us":176}
I20260812 11:23:13.615634 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.609783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.15.164.253:43661)
0812 11:23:13.610030 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.610040 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.610678 (+ 638us) server_negotiation.cc:407] Connection header received
0812 11:23:13.610909 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.610914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.610986 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.611088 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.611522 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.612308 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.613723 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.614162 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.614314 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.614831 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.614945 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.615050 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.615179 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.615267 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 11:23:13.624424 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.622024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.15.164.252:34675)
0812 11:23:13.622257 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.622266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.622841 (+ 575us) server_negotiation.cc:407] Connection header received
0812 11:23:13.623082 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.623094 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.623201 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.623301 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.624121 (+ 820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51042: BlockingRecv error: recv got EOF from 127.0.0.1:51042 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:23:13.651665 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.644748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.15.164.253:43661)
0812 11:23:13.645011 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.645038 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.645592 (+ 554us) server_negotiation.cc:407] Connection header received
0812 11:23:13.645844 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.645849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.645930 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.646044 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.646597 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.647540 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.648983 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.649461 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.649619 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.650119 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.650268 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.650389 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.650586 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.651246 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260812 11:23:13.660625 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.658032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.15.164.252:34675)
0812 11:23:13.658290 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.658300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.658988 (+ 688us) server_negotiation.cc:407] Connection header received
0812 11:23:13.659220 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.659228 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.659327 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.659445 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.660327 (+ 882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51048: BlockingRecv error: recv got EOF from 127.0.0.1:51048 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:23:13.702256 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.696268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42540 (local address 127.15.164.253:43661)
0812 11:23:13.696557 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.696567 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.697112 (+ 545us) server_negotiation.cc:407] Connection header received
0812 11:23:13.697348 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.697353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.697423 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.697524 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.697957 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.698780 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.700366 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.700893 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.701042 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.701465 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.701570 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.701669 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.701825 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.701905 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 11:23:13.710803 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.708546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51058 (local address 127.15.164.252:34675)
0812 11:23:13.708766 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.708774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.709318 (+ 544us) server_negotiation.cc:407] Connection header received
0812 11:23:13.709535 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.709541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.709634 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.709751 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.710561 (+ 810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51058: BlockingRecv error: recv got EOF from 127.0.0.1:51058 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:23:13.785178 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.778536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42552 (local address 127.15.164.253:43661)
0812 11:23:13.778790 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.778796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.779242 (+ 446us) server_negotiation.cc:407] Connection header received
0812 11:23:13.779496 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.779504 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.779587 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.779696 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.780245 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.781087 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.783212 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.783699 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.783809 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.784374 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.784488 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.784567 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.784742 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.784815 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:23:13.794332 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.792237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51074 (local address 127.15.164.252:34675)
0812 11:23:13.792438 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.792445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.792877 (+ 432us) server_negotiation.cc:407] Connection header received
0812 11:23:13.793025 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.793032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.793144 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.793257 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.794090 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51074: BlockingRecv error: recv got EOF from 127.0.0.1:51074 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:23:13.932900 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:13.926450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42564 (local address 127.15.164.253:43661)
0812 11:23:13.926678 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.926685 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.927045 (+ 360us) server_negotiation.cc:407] Connection header received
0812 11:23:13.927234 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.927240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.927352 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.927470 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:13.927963 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.929142 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.930595 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:13.931280 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:13.931423 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:13.932056 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:13.932217 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:13.932310 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:13.932477 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:23:13.932563 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 11:23:13.943825 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:13.941783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51088 (local address 127.15.164.252:34675)
0812 11:23:13.942022 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:13.942031 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:13.942415 (+ 384us) server_negotiation.cc:407] Connection header received
0812 11:23:13.942649 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:13.942653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:13.942759 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:13.942854 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:13.943618 (+ 764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51088: BlockingRecv error: recv got EOF from 127.0.0.1:51088 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:23:14.209160 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.203739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42568 (local address 127.15.164.253:43661)
0812 11:23:14.204020 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.204028 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.204331 (+ 303us) server_negotiation.cc:407] Connection header received
0812 11:23:14.204569 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.204576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.204702 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.204813 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.205270 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.206018 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.207431 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.207868 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.208016 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.208451 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.208556 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.208657 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.208814 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.208894 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
W20260812 11:23:14.217231 21101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:23:14.215216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.15.164.252:34675)
0812 11:23:14.215384 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.215388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.215860 (+ 472us) server_negotiation.cc:407] Connection header received
0812 11:23:14.216018 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.216022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.216092 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.216180 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:23:14.216985 (+ 805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51090: BlockingRecv error: recv got EOF from 127.0.0.1:51090 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:23:14.400286 21187 catalog_manager.cc:1259] Loaded cluster ID: b1fe0eb7fd094321b3caa971fd819bb8
I20260812 11:23:14.400418 21187 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: loading cluster ID for follower catalog manager: success
I20260812 11:23:14.403584 21187 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: acquiring CA information for follower catalog manager: success
I20260812 11:23:14.405582 21187 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f21117d388824527b71c0771ca2ebf0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:23:14.745383 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.739922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42572 (local address 127.15.164.253:43661)
0812 11:23:14.740452 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.740461 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.740509 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:23:14.740785 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.740789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.740863 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.740990 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.741463 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.742208 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.743603 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.744047 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.744188 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.744613 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.744730 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.744832 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.745008 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.745090 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":255,"threads_started":1}
I20260812 11:23:14.758235 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.751712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51094 (local address 127.15.164.252:34675)
0812 11:23:14.752446 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.752450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.752467 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:23:14.752530 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.752534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.752689 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.752797 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.753258 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.753960 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.755942 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.756396 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.756498 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.757022 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.757676 (+ 654us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.757799 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.757887 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.757956 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":514,"threads_started":1}
I20260812 11:23:14.772193 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.764027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51108 (local address 127.15.164.252:34675)
0812 11:23:14.764218 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.764227 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.764995 (+ 768us) server_negotiation.cc:407] Connection header received
0812 11:23:14.765161 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.765169 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.765284 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.765400 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.765960 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.767236 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.769452 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.770194 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.770327 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.771238 (+ 911us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.771377 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.771455 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.771751 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.771836 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:23:14.774979 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.767215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42582 (local address 127.15.164.253:43661)
0812 11:23:14.767433 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.767439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.768119 (+ 680us) server_negotiation.cc:407] Connection header received
0812 11:23:14.768339 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.768345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.768434 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.768541 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.769328 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.770547 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.773021 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.773482 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.773579 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.774151 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.774253 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.774324 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.774539 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.774636 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:23:14.775015 21407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:23:14.764171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40338 (local address 127.15.164.254:46429)
0812 11:23:14.764716 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 11:23:14.764722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:23:14.767065 (+ 2343us) server_negotiation.cc:407] Connection header received
0812 11:23:14.767477 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:23:14.767485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:23:14.767784 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:23:14.767950 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:23:14.768985 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.769948 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.772068 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:23:14.772601 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:23:14.772766 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:23:14.773852 (+ 1086us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:23:14.774363 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:23:14.774521 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:23:14.774679 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 11:23:14.774771 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":289,"threads_started":1}
I20260812 11:23:14.780303 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20745
I20260812 11:23:14.782011 20853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:14.895284 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20745
I20260812 11:23:14.930220 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20873
I20260812 11:23:14.931442 20969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:15.041849 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20873
I20260812 11:23:15.074167 16019 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskghXBKM/build/asan/bin/kudu pid 20990
I20260812 11:23:15.075634 21085 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:23:15.184062 16019 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskghXBKM/build/asan/bin/kudu with pid 20990
2026-08-12T11:23:15Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5430 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10695 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (397789 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST